Oct 17 11:39:50 user nova-compute[74261]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74261) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74261) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74261) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 17 11:39:50 user nova-compute[74261]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:39:50 user nova-compute[74261]: INFO nova.virt.driver [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 17 11:39:50 user nova-compute[74261]: INFO nova.compute.provider_config [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Acquiring lock "singleton_lock" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Acquired lock "singleton_lock" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Releasing lock "singleton_lock" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Full set of CONF: {{(pid=74261) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ******************************************************************************** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Configuration options gathered from: {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ================================================================================ {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] allow_resize_to_same_host      = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] arq_binding_timeout            = 300 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] backdoor_port                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] backdoor_socket                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] block_device_allocate_retries  = 300 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] block_device_allocate_retries_interval = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cert                           = self.pem {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute_monitors               = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] config_dir                     = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] config_drive_format            = iso9660 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] config_source                  = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] console_host                   = user {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] control_exchange               = nova {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cpu_allocation_ratio           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] daemon                         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] debug                          = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] default_access_ip_network_name = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] default_availability_zone      = nova {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] default_ephemeral_format       = ext4 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] default_green_pool_size        = 1000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] default_schedule_zone          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] disk_allocation_ratio          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] enable_new_services            = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] enabled_ssl_apis               = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] flat_injected                  = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] force_config_drive             = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] force_raw_images               = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] graceful_shutdown_timeout      = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] heal_instance_info_cache_interval = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] host                           = user {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_build_timeout         = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_delete_interval       = 300 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_name_template         = instance-%08x {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_usage_audit           = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_usage_audit_period    = month {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] internal_service_availability_zone = internal {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] key                            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] live_migration_retry_count     = 30 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_config_append              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_dir                        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_file                       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_options                    = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_rotate_interval            = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_rotate_interval_type       = days {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] log_rotation_type              = none {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] long_rpc_timeout               = 1800 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] max_concurrent_builds          = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] max_concurrent_live_migrations = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] max_concurrent_snapshots       = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] max_local_block_devices        = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] max_logfile_count              = 30 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] max_logfile_size_mb            = 200 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] maximum_instance_delete_attempts = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metadata_listen                = 0.0.0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metadata_listen_port           = 8775 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metadata_workers               = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] migrate_max_retries            = -1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] mkisofs_cmd                    = genisoimage {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] my_ip                          = 10.0.0.210 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] network_allocate_retries       = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] osapi_compute_listen_port      = 8774 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] osapi_compute_unique_server_name_scope =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] osapi_compute_workers          = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] password_length                = 12 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] periodic_enable                = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] periodic_fuzzy_delay           = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] pointer_model                  = ps2mouse {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] preallocate_images             = none {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] publish_errors                 = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] pybasedir                      = /opt/stack/nova {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ram_allocation_ratio           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rate_limit_burst               = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rate_limit_except_level        = CRITICAL {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rate_limit_interval            = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reboot_timeout                 = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reclaim_instance_interval      = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] record                         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reimage_timeout_per_gb         = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] report_interval                = 120 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rescue_timeout                 = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reserved_host_cpus             = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reserved_host_disk_mb          = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reserved_host_memory_mb        = 512 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] reserved_huge_pages            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] resize_confirm_window          = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] resize_fs_using_block_device   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] resume_guests_state_on_host_boot = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rpc_response_timeout           = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] run_external_periodic_tasks    = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] running_deleted_instance_action = reap {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] running_deleted_instance_timeout = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler_instance_sync_interval = 120 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_down_time              = 720 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] servicegroup_driver            = db {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] shelved_offload_time           = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] shelved_poll_interval          = 3600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] shutdown_timeout               = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] source_is_ipv6                 = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ssl_only                       = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] state_path                     = /opt/stack/data/nova {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] sync_power_state_interval      = 600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] sync_power_state_pool_size     = 1000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] syslog_log_facility            = LOG_USER {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] tempdir                        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] timeout_nbd                    = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] transport_url                  = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] update_resources_interval      = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_cow_images                 = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_eventlog                   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_journal                    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_json                       = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_rootwrap_daemon            = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_stderr                     = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] use_syslog                     = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vcpu_pin_set                   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plugging_is_fatal          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plugging_timeout           = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] virt_mkfs                      = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] volume_usage_poll_interval     = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] watch_log_file                 = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] web                            = /usr/share/spice-html5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_concurrency.disable_process_locking = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.auth_strategy              = keystone {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.compute_link_prefix        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.dhcp_domain                = novalocal {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.enable_instance_password   = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.glance_link_prefix         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.instance_list_per_project_cells = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.list_records_by_skipping_down_cells = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.local_metadata_per_cell    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.max_limit                  = 1000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.metadata_cache_expiration  = 15 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.neutron_default_tenant_id  = default {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.use_forwarded_for          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.use_neutron_default_nets   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_dynamic_targets = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_jsonfile_path   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.backend_argument         = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.config_prefix            = cache.oslo {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.dead_timeout             = 60.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.debug_cache_backend      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.enable_retry_client      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.enable_socket_keepalive  = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.enabled                  = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.expiration_time          = 600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.hashclient_retry_attempts = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_dead_retry      = 300 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_password        =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_sasl_enabled    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.memcache_username        =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.proxies                  = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.retry_attempts           = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.retry_delay              = 0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.socket_keepalive_count   = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.socket_keepalive_idle    = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.socket_keepalive_interval = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.tls_allowed_ciphers      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.tls_cafile               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.tls_certfile             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.tls_enabled              = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cache.tls_keyfile              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.auth_section            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.auth_type               = password {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.cafile                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.certfile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.collect_timing          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.cross_az_attach         = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.debug                   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.endpoint_template       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.http_retries            = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.insecure                = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.keyfile                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.os_region_name          = RegionOne {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.split_loggers           = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cinder.timeout                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.cpu_dedicated_set      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.cpu_shared_set         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.image_type_exclude_list = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.resource_provider_association_refresh = 300 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.shutdown_retry_interval = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] conductor.workers              = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] console.allowed_origins        = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] console.ssl_ciphers            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] console.ssl_minimum_version    = default {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] consoleauth.token_ttl          = 600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.cafile                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.certfile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.collect_timing          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.connect_retries         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.connect_retry_delay     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.endpoint_override       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.insecure                = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.keyfile                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.max_version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.min_version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.region_name             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.service_name            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.service_type            = accelerator {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.split_loggers           = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.status_code_retries     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.timeout                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] cyborg.version                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.backend               = sqlalchemy {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.connection            = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.connection_debug      = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.connection_parameters =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.connection_recycle_time = 3600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.connection_trace      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.db_inc_retry_interval = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.db_max_retries        = 20 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.db_max_retry_interval = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.db_retry_interval     = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.max_overflow          = 50 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.max_pool_size         = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.max_retries           = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.mysql_wsrep_sync_wait = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.pool_timeout          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.retry_interval        = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.slave_connection      = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] database.sqlite_synchronous    = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.backend           = sqlalchemy {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.connection        = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.connection_debug  = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.connection_parameters =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.connection_recycle_time = 3600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.connection_trace  = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.db_inc_retry_interval = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.db_max_retries    = 20 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.db_max_retry_interval = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.db_retry_interval = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.max_overflow      = 50 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.max_pool_size     = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.max_retries       = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.pool_timeout      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.retry_interval    = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.slave_connection  = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] api_database.sqlite_synchronous = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] devices.enabled_mdev_types     = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ephemeral_storage_encryption.enabled = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.api_servers             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.cafile                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.certfile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.collect_timing          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.connect_retries         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.connect_retry_delay     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.debug                   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.default_trusted_certificate_ids = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.enable_certificate_validation = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.enable_rbd_download     = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.endpoint_override       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.insecure                = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.keyfile                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.max_version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.min_version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.num_retries             = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.rbd_ceph_conf           =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.rbd_connect_timeout     = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.rbd_pool                =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.rbd_user                =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.region_name             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.service_name            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.service_type            = image {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.split_loggers           = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.status_code_retries     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.timeout                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.verify_glance_signatures = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] glance.version                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] guestfs.debug                  = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.config_drive_cdrom      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.config_drive_inject_password = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.enable_remotefx         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.instances_path_share    =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.limit_cpu_features      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.use_multipath_io        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.vswitch_name            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] mks.enabled                    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] image_cache.manager_interval   = 2400 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] image_cache.precache_concurrency = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] image_cache.remove_unused_base_images = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] image_cache.subdirectory_name  = _base {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.api_max_retries         = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.api_retry_interval      = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.auth_section            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.auth_type               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.cafile                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.certfile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.collect_timing          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.conductor_group         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.connect_retries         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.connect_retry_delay     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.endpoint_override       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.insecure                = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.keyfile                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.max_version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.min_version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.peer_list               = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.region_name             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.serial_console_state_timeout = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.service_name            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.service_type            = baremetal {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.split_loggers           = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.status_code_retries     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.timeout                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ironic.version                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] key_manager.fixed_key          = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.barbican_api_version  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.barbican_endpoint     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.barbican_endpoint_type = public {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.barbican_region_name  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.cafile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.certfile              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.collect_timing        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.insecure              = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.keyfile               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.number_of_retries     = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.retry_delay           = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.send_service_user_token = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.split_loggers         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.timeout               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.verify_ssl            = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican.verify_ssl_path       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.auth_section = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.auth_type = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.cafile   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.certfile = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.collect_timing = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.insecure = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.keyfile  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.split_loggers = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] barbican_service_user.timeout  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.approle_role_id          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.approle_secret_id        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.cafile                   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.certfile                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.collect_timing           = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.insecure                 = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.keyfile                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.kv_mountpoint            = secret {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.kv_path                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.kv_version               = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.namespace                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.root_token_id            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.split_loggers            = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.ssl_ca_crt_file          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.timeout                  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.use_ssl                  = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.auth_section          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.auth_type             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.cafile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.certfile              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.collect_timing        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.connect_retries       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.connect_retry_delay   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.endpoint_override     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.insecure              = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.keyfile               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.max_version           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.min_version           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.region_name           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.service_name          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.service_type          = identity {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.split_loggers         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.status_code_retries   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.timeout               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] keystone.version               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.connection_uri         =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_mode               = custom {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: WARNING oslo_config.cfg [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_power_governor_high = performance {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_power_management   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.device_detach_attempts = 8 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.device_detach_timeout  = 20 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.disk_cachemodes        = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.disk_prefix            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.enabled_perf_events    = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.file_backed_memory     = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.gid_maps               = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.hw_disk_discard        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.hw_machine_type        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_rbd_pool        = rbd {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_type            = default {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.images_volume_group    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.inject_key             = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.inject_partition       = -2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.inject_password        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.iscsi_iface            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.iser_use_multipath     = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_downtime = 500 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_inbound_addr = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_scheme  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_timeout_action = abort {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_tunnelled = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: WARNING oslo_config.cfg [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 17 11:39:50 user nova-compute[74261]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 17 11:39:50 user nova-compute[74261]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 17 11:39:50 user nova-compute[74261]: and ``live_migration_inbound_addr`` respectively.
Oct 17 11:39:50 user nova-compute[74261]: ).  Its value may be silently ignored in the future.
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.live_migration_with_native_tls = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.max_queues             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.nfs_mount_options      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.num_pcie_ports         = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.pmem_namespaces        = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.quobyte_client_cfg     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rbd_secret_uuid        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rbd_user               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rescue_image_id        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rescue_kernel_id       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.rx_queue_size          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.smbfs_mount_options    =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.snapshot_compression   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.snapshot_image_format  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.sparse_logical_volumes = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.swtpm_enabled          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.swtpm_group            = tss {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.swtpm_user             = tss {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.sysinfo_serial         = unique {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.tb_cache_size          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.tx_queue_size          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.uid_maps               = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.use_virtio_for_bridges = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.virt_type              = kvm {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.volume_clear           = zero {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.volume_clear_size      = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.volume_use_multipath   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_cache_path   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.auth_section           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.auth_type              = password {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.cafile                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.certfile               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.collect_timing         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.connect_retries        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.connect_retry_delay    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.default_floating_pool  = public {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.endpoint_override      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.extension_sync_interval = 600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.http_retries           = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.insecure               = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.keyfile                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.max_version            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.min_version            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.ovs_bridge             = br-int {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.physnets               = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.region_name            = RegionOne {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.service_metadata_proxy = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.service_name           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.service_type           = network {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.split_loggers          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.status_code_retries    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.timeout                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] neutron.version                = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] notifications.bdms_in_notifications = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] notifications.default_level    = INFO {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] notifications.notification_format = unversioned {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] notifications.notify_on_state_change = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] pci.alias                      = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] pci.device_spec                = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] pci.report_in_placement        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.auth_section         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.auth_type            = password {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.cafile               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.certfile             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.collect_timing       = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.connect_retries      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.connect_retry_delay  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.default_domain_id    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.default_domain_name  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.domain_id            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.domain_name          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.endpoint_override    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.insecure             = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.keyfile              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.max_version          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.min_version          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.password             = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.project_domain_id    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.project_domain_name  = Default {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.project_id           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.project_name         = service {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.region_name          = RegionOne {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.service_name         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.service_type         = placement {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.split_loggers        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.status_code_retries  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.system_scope         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.timeout              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.trust_id             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.user_domain_id       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.user_domain_name     = Default {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.user_id              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.username             = placement {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] placement.version              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.cores                    = 20 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.count_usage_from_placement = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.injected_file_content_bytes = 10240 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.injected_file_path_length = 255 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.injected_files           = 5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.instances                = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.key_pairs                = 100 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.metadata_items           = 128 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.ram                      = 51200 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.recheck_quota            = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.server_group_members     = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] quota.server_groups            = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rdp.enabled                    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.image_metadata_prefilter = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.max_attempts         = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.max_placement_results = 1000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] scheduler.workers              = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.host_subset_size = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.isolated_hosts = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.isolated_images = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.pci_in_placement = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.track_instance_changes = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metrics.required               = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metrics.weight_multiplier      = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] metrics.weight_setting         = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] serial_console.enabled         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] serial_console.port_range      = 10000:20000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] serial_console.serialproxy_port = 6083 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.auth_section      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.auth_type         = password {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.cafile            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.certfile          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.collect_timing    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.insecure          = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.keyfile           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.send_service_user_token = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.split_loggers     = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] service_user.timeout           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.agent_enabled            = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.enabled                  = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.html5proxy_port          = 6082 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.image_compression        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.jpeg_compression         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.playback_compression     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.server_listen            = 127.0.0.1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.streaming_mode           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] spice.zlib_compression         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] upgrade_levels.baseapi         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] upgrade_levels.cert            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] upgrade_levels.compute         = auto {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] upgrade_levels.conductor       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] upgrade_levels.scheduler       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.cafile = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.certfile = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.insecure = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vendordata_dynamic_auth.timeout = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.api_retry_count         = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.ca_file                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.cache_prefix            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.cluster_name            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.connection_pool_size    = 10 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.console_delay_seconds   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.datastore_regex         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.host_ip                 = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.host_password           = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.host_port               = 443 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.host_username           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.insecure                = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.integration_bridge      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.maximum_objects         = 100 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.pbm_default_policy      = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.pbm_enabled             = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.pbm_wsdl_location       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.serial_port_proxy_uri   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.serial_port_service_uri = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.task_poll_interval      = 0.5 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.use_linked_clone        = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.vnc_keymap              = en-us {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.vnc_port                = 5900 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vmware.vnc_port_total          = 10000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.auth_schemes               = ['none'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.enabled                    = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.novncproxy_port            = 6080 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.vencrypt_ca_certs          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.vencrypt_client_cert       = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vnc.vencrypt_client_key        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.disable_rootwrap   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.enable_numa_live_migration = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.libvirt_disable_apic = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.client_socket_timeout     = 900 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.default_pool_size         = 1000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.keep_alive                = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.max_header_line           = 16384 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.ssl_ca_file               = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.ssl_cert_file             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.ssl_key_file              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.tcp_keepidle              = 600 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] zvm.ca_file                    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] zvm.cloud_connector_url        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] zvm.reachable_timeout          = 300 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.enforce_new_defaults = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.enforce_scope      = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.policy_default_rule = default {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.connection_string     = messaging:// {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.enabled               = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.es_doc_type           = notification {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.es_scroll_size        = 10000 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.es_scroll_time        = 2m {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.filter_error_trace    = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.hmac_keys             = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.sentinel_service_name = mymaster {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.socket_timeout        = 0.1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.trace_requests        = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:50 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler.trace_sqlalchemy      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler_jaeger.process_tags   = {} {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler_jaeger.service_name_prefix = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] profiler_otlp.service_name_prefix = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] remote_debug.host              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] remote_debug.port              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_notifications.retry = -1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.auth_section        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.auth_type           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.cafile              = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.certfile            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.collect_timing      = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.connect_retries     = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.connect_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.endpoint_id         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.endpoint_override   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.insecure            = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.keyfile             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.max_version         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.min_version         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.region_name         = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.service_name        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.service_type        = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.split_loggers       = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.status_code_retries = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.status_code_retry_delay = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.timeout             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.valid_interfaces    = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_limit.version             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_reports.file_event_handler = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] oslo_reports.log_dir           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_ovs_privileged.group  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] vif_plug_ovs_privileged.user   = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.isolate_vif         = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] os_brick.lock_path             = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] privsep_osbrick.capabilities   = [21] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] privsep_osbrick.group          = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] privsep_osbrick.helper_command = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] privsep_osbrick.user           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] nova_sys_admin.group           = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] nova_sys_admin.helper_command  = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] nova_sys_admin.user            = None {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG oslo_service.service [None req-c1410b8b-c745-48a6-b7be-4d107df254a8 None None] ******************************************************************************** {{(pid=74261) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 17 11:39:51 user nova-compute[74261]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Connecting to libvirt: qemu:///system {{(pid=74261) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8b2d425270> {{(pid=74261) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 17 11:39:51 user nova-compute[74261]: libvirt:  error : internal error: could not initialize domain event timer
Oct 17 11:39:51 user nova-compute[74261]: WARNING nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8b2d425270> {{(pid=74261) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Starting native event thread {{(pid=74261) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Starting green dispatch thread {{(pid=74261) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Starting connection event dispatch thread {{(pid=74261) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 17 11:39:51 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Connection event '1' reason 'None'
Oct 17 11:39:51 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 17 11:39:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.mount [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Initialising _HostMountState generation 0 {{(pid=74261) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 17 11:39:58 user nova-compute[74261]: INFO nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host capabilities <capabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <host>
Oct 17 11:39:58 user nova-compute[74261]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 17 11:39:58 user nova-compute[74261]:     <cpu>
Oct 17 11:39:58 user nova-compute[74261]:       <arch>x86_64</arch>
Oct 17 11:39:58 user nova-compute[74261]:       <model>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <microcode version='1070'/>
Oct 17 11:39:58 user nova-compute[74261]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='osxsave'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='invtsc'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='rsba'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature name='skip-l1dfl-vmentry'/>
Oct 17 11:39:58 user nova-compute[74261]:       <pages unit='KiB' size='4'/>
Oct 17 11:39:58 user nova-compute[74261]:       <pages unit='KiB' size='2048'/>
Oct 17 11:39:58 user nova-compute[74261]:     </cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <power_management>
Oct 17 11:39:58 user nova-compute[74261]:       <suspend_mem/>
Oct 17 11:39:58 user nova-compute[74261]:       <suspend_disk/>
Oct 17 11:39:58 user nova-compute[74261]:       <suspend_hybrid/>
Oct 17 11:39:58 user nova-compute[74261]:     </power_management>
Oct 17 11:39:58 user nova-compute[74261]:     <iommu support='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <migration_features>
Oct 17 11:39:58 user nova-compute[74261]:       <live/>
Oct 17 11:39:58 user nova-compute[74261]:       <uri_transports>
Oct 17 11:39:58 user nova-compute[74261]:         <uri_transport>tcp</uri_transport>
Oct 17 11:39:58 user nova-compute[74261]:         <uri_transport>rdma</uri_transport>
Oct 17 11:39:58 user nova-compute[74261]:       </uri_transports>
Oct 17 11:39:58 user nova-compute[74261]:     </migration_features>
Oct 17 11:39:58 user nova-compute[74261]:     <topology>
Oct 17 11:39:58 user nova-compute[74261]:       <cells num='2'>
Oct 17 11:39:58 user nova-compute[74261]:         <cell id='0'>
Oct 17 11:39:58 user nova-compute[74261]:           <memory unit='KiB'>8140616</memory>
Oct 17 11:39:58 user nova-compute[74261]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 17 11:39:58 user nova-compute[74261]:           <pages unit='KiB' size='2048'>0</pages>
Oct 17 11:39:58 user nova-compute[74261]:           <distances>
Oct 17 11:39:58 user nova-compute[74261]:             <sibling id='0' value='10'/>
Oct 17 11:39:58 user nova-compute[74261]:             <sibling id='1' value='20'/>
Oct 17 11:39:58 user nova-compute[74261]:           </distances>
Oct 17 11:39:58 user nova-compute[74261]:           <cpus num='6'>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 17 11:39:58 user nova-compute[74261]:           </cpus>
Oct 17 11:39:58 user nova-compute[74261]:         </cell>
Oct 17 11:39:58 user nova-compute[74261]:         <cell id='1'>
Oct 17 11:39:58 user nova-compute[74261]:           <memory unit='KiB'>8255100</memory>
Oct 17 11:39:58 user nova-compute[74261]:           <pages unit='KiB' size='4'>2063775</pages>
Oct 17 11:39:58 user nova-compute[74261]:           <pages unit='KiB' size='2048'>0</pages>
Oct 17 11:39:58 user nova-compute[74261]:           <distances>
Oct 17 11:39:58 user nova-compute[74261]:             <sibling id='0' value='20'/>
Oct 17 11:39:58 user nova-compute[74261]:             <sibling id='1' value='10'/>
Oct 17 11:39:58 user nova-compute[74261]:           </distances>
Oct 17 11:39:58 user nova-compute[74261]:           <cpus num='6'>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 17 11:39:58 user nova-compute[74261]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 17 11:39:58 user nova-compute[74261]:           </cpus>
Oct 17 11:39:58 user nova-compute[74261]:         </cell>
Oct 17 11:39:58 user nova-compute[74261]:       </cells>
Oct 17 11:39:58 user nova-compute[74261]:     </topology>
Oct 17 11:39:58 user nova-compute[74261]:     <cache>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 17 11:39:58 user nova-compute[74261]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 17 11:39:58 user nova-compute[74261]:     </cache>
Oct 17 11:39:58 user nova-compute[74261]:     <secmodel>
Oct 17 11:39:58 user nova-compute[74261]:       <model>apparmor</model>
Oct 17 11:39:58 user nova-compute[74261]:       <doi>0</doi>
Oct 17 11:39:58 user nova-compute[74261]:     </secmodel>
Oct 17 11:39:58 user nova-compute[74261]:     <secmodel>
Oct 17 11:39:58 user nova-compute[74261]:       <model>dac</model>
Oct 17 11:39:58 user nova-compute[74261]:       <doi>0</doi>
Oct 17 11:39:58 user nova-compute[74261]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 17 11:39:58 user nova-compute[74261]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 17 11:39:58 user nova-compute[74261]:     </secmodel>
Oct 17 11:39:58 user nova-compute[74261]:   </host>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='alpha'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>clipper</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='armv6l'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>integratorcp</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>borzoi</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>spitz</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>nuri</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>musca-b1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>versatileab</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>kzm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>musca-a</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>smdkc210</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sx1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>z2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>tosa</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>sabrelite</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>realview-eb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>n810</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>n800</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>versatilepb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>terrier</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mainstone</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>midway</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>musicpal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>microbit</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>cubieboard</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>verdex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>netduino2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>raspi2b</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>cheetah</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>highbank</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>akita</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>connex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>collie</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>raspi0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='armv7l'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>integratorcp</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>borzoi</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>spitz</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>nuri</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>musca-b1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>versatileab</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>kzm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>musca-a</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>smdkc210</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sx1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>z2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>tosa</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>sabrelite</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>realview-eb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>n810</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>n800</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>versatilepb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>terrier</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mainstone</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>midway</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>musicpal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>microbit</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>cubieboard</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>verdex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>netduino2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>raspi2b</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>cheetah</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>highbank</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>akita</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>connex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>collie</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>raspi0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='aarch64'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>integratorcp</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>borzoi</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>spitz</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>nuri</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>musca-b1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>versatileab</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>kzm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>musca-a</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>smdkc210</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sx1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>z2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>tosa</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>sabrelite</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>realview-eb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>n810</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>n800</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>versatilepb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>terrier</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mainstone</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>midway</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>musicpal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>microbit</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>cubieboard</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>verdex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>netduino2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>raspi3b</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>raspi2b</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>cheetah</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>highbank</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>akita</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>connex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>collie</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>raspi0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <acpi default='on' toggle='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='cris'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='i686'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>x-remote</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>isapc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>microvm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='kvm'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <pae/>
Oct 17 11:39:58 user nova-compute[74261]:       <nonpae/>
Oct 17 11:39:58 user nova-compute[74261]:       <acpi default='on' toggle='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:       <apic default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='m68k'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>an5206</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>q800</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>next-cube</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='microblaze'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='microblazeel'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='mips'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='16'>malta</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='mipsel'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='16'>malta</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='mips64'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='16'>malta</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>pica61</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>magnum</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='mips64el'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='16'>malta</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>pica61</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>magnum</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='16'>boston</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='ppc'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>g3beige</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mac99</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ppce500</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>pegasos2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sam460ex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>bamboo</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>40p</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>ref405ep</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>taihu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='ppc64'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2048'>powernv9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>taihu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2048'>powernv10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ppce500</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>40p</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>pegasos2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>bamboo</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>g3beige</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mac99</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sam460ex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>ref405ep</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2048'>powernv8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='ppc64le'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2048'>powernv9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>taihu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2048'>powernv10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ppce500</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>40p</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>pegasos2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>bamboo</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>g3beige</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>mac99</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sam460ex</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>ref405ep</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2048'>powernv8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='riscv32'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='8'>spike</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>opentitan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='5'>sifive_u</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sifive_e</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='8'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='riscv64'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='8'>spike</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='5'>sifive_u</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>shakti_c</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sifive_e</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='8'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='s390x'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='sh4'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>shix</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>r2d</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='sh4eb'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>shix</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>r2d</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='sparc'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>SS-5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>SS-20</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>LX</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>SS-4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>SS-10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>Voyager</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='sparc64'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sun4u</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>niagara</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>sun4v</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='x86_64'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>64</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>x-remote</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='1'>isapc</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>microvm</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='kvm'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <acpi default='on' toggle='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:       <apic default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='xtensa'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>sim</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>kc705</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ml605</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx200</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx60</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]:   <guest>
Oct 17 11:39:58 user nova-compute[74261]:     <os_type>hvm</os_type>
Oct 17 11:39:58 user nova-compute[74261]:     <arch name='xtensaeb'>
Oct 17 11:39:58 user nova-compute[74261]:       <wordsize>32</wordsize>
Oct 17 11:39:58 user nova-compute[74261]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='4'>sim</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>kc705</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ml605</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>virt</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx200</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>lx60</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 17 11:39:58 user nova-compute[74261]:       <domain type='qemu'/>
Oct 17 11:39:58 user nova-compute[74261]:     </arch>
Oct 17 11:39:58 user nova-compute[74261]:     <features>
Oct 17 11:39:58 user nova-compute[74261]:       <cpuselection/>
Oct 17 11:39:58 user nova-compute[74261]:       <deviceboot/>
Oct 17 11:39:58 user nova-compute[74261]:       <disksnapshot default='on' toggle='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     </features>
Oct 17 11:39:58 user nova-compute[74261]:   </guest>
Oct 17 11:39:58 user nova-compute[74261]: </capabilities>
Oct 17 11:39:58 user nova-compute[74261]: 
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-q35-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>i686</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='288'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'/>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='lm'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-q35-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>i686</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='288'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'/>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='lm'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-i440fx-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>i686</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='255'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'/>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='lm'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ide</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-i440fx-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>i686</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='255'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'/>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='lm'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ide</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-q35-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>x86_64</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='288'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>efi</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='invtsc'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='rsba'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-q35-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>x86_64</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='288'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>efi</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='invtsc'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='rsba'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-i440fx-6.2</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>x86_64</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='255'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>efi</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='invtsc'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='rsba'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ide</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 17 11:39:58 user nova-compute[74261]: <domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 11:39:58 user nova-compute[74261]:   <domain>kvm</domain>
Oct 17 11:39:58 user nova-compute[74261]:   <machine>pc-i440fx-jammy</machine>
Oct 17 11:39:58 user nova-compute[74261]:   <arch>x86_64</arch>
Oct 17 11:39:58 user nova-compute[74261]:   <vcpu max='255'/>
Oct 17 11:39:58 user nova-compute[74261]:   <iothreads supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:   <os supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='firmware'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>efi</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:     <loader supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>rom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pflash</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='readonly'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>yes</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='secure'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>no</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </loader>
Oct 17 11:39:58 user nova-compute[74261]:   </os>
Oct 17 11:39:58 user nova-compute[74261]:   <cpu>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-passthrough' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='hostPassthroughMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='maximum' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='maximumMigratable'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>on</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>off</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='host-model' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <vendor>Intel</vendor>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ss'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='vmx'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pcid'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='hypervisor'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arat'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='umip'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='md-clear'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='invtsc'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibpb'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='ibrs'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-stibp'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='rsba'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='erms'/>
Oct 17 11:39:58 user nova-compute[74261]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:     <mode name='custom' supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>qemu64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>qemu32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>phenom</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>pentium</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>n270</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm64</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>kvm32</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>coreduo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>core2duo</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>athlon</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Westmere</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Snowridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Skylake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>SandyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Penryn</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G5</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G4</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G3</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Opteron_G2</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Opteron_G1</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>IvyBridge</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Icelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Haswell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Rome</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-Milan</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>EPYC</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Dhyana</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cooperlake</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>Conroe</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='no'>Broadwell</model>
Oct 17 11:39:58 user nova-compute[74261]:       <model usable='yes'>486</model>
Oct 17 11:39:58 user nova-compute[74261]:     </mode>
Oct 17 11:39:58 user nova-compute[74261]:   </cpu>
Oct 17 11:39:58 user nova-compute[74261]:   <memoryBacking supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:     <enum name='sourceType'>
Oct 17 11:39:58 user nova-compute[74261]:       <value>file</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>anonymous</value>
Oct 17 11:39:58 user nova-compute[74261]:       <value>memfd</value>
Oct 17 11:39:58 user nova-compute[74261]:     </enum>
Oct 17 11:39:58 user nova-compute[74261]:   </memoryBacking>
Oct 17 11:39:58 user nova-compute[74261]:   <devices>
Oct 17 11:39:58 user nova-compute[74261]:     <disk supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='diskDevice'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>disk</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cdrom</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>floppy</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>lun</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='bus'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ide</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>fdc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sata</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </disk>
Oct 17 11:39:58 user nova-compute[74261]:     <graphics supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='type'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>sdl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vnc</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>spice</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egl-headless</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </graphics>
Oct 17 11:39:58 user nova-compute[74261]:     <video supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='modelType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>cirrus</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>vmvga</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>qxl</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>none</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>bochs</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>ramfb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </video>
Oct 17 11:39:58 user nova-compute[74261]:     <hostdev supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='mode'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>subsystem</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='startupPolicy'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>default</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>mandatory</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>requisite</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>optional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='subsysType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>usb</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>pci</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>scsi</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='capsType'/>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='pciBackend'/>
Oct 17 11:39:58 user nova-compute[74261]:     </hostdev>
Oct 17 11:39:58 user nova-compute[74261]:     <rng supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtio-non-transitional</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>random</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>egd</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>builtin</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </rng>
Oct 17 11:39:58 user nova-compute[74261]:     <filesystem supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='driverType'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>path</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>handle</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>virtiofs</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </filesystem>
Oct 17 11:39:58 user nova-compute[74261]:     <tpm supported='yes'>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='model'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-tis</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>tpm-crb</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:       <enum name='backendModel'>
Oct 17 11:39:58 user nova-compute[74261]:         <value>passthrough</value>
Oct 17 11:39:58 user nova-compute[74261]:         <value>emulator</value>
Oct 17 11:39:58 user nova-compute[74261]:       </enum>
Oct 17 11:39:58 user nova-compute[74261]:     </tpm>
Oct 17 11:39:58 user nova-compute[74261]:   </devices>
Oct 17 11:39:58 user nova-compute[74261]:   <features>
Oct 17 11:39:58 user nova-compute[74261]:     <gic supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:     <vmcoreinfo supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <genid supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backingStoreInput supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <backup supported='yes'/>
Oct 17 11:39:58 user nova-compute[74261]:     <sev supported='no'/>
Oct 17 11:39:58 user nova-compute[74261]:   </features>
Oct 17 11:39:58 user nova-compute[74261]: </domainCapabilities>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74261) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74261) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Checking secure boot support for host arch (x86_64) {{(pid=74261) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 17 11:39:58 user nova-compute[74261]: INFO nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Secure Boot support detected
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] cpu compare xml: <cpu match="exact">
Oct 17 11:39:58 user nova-compute[74261]:   <model>Nehalem</model>
Oct 17 11:39:58 user nova-compute[74261]: </cpu>
Oct 17 11:39:58 user nova-compute[74261]:  {{(pid=74261) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 17 11:39:58 user nova-compute[74261]: INFO nova.virt.node [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Generated node identity d51b7aad-e6a4-40b3-931d-8430348db4c8
Oct 17 11:39:58 user nova-compute[74261]: INFO nova.virt.node [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Wrote node identity d51b7aad-e6a4-40b3-931d-8430348db4c8 to /opt/stack/data/nova/compute_id
Oct 17 11:39:58 user nova-compute[74261]: WARNING nova.compute.manager [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Compute nodes ['d51b7aad-e6a4-40b3-931d-8430348db4c8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 17 11:39:58 user nova-compute[74261]: INFO nova.compute.manager [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 17 11:39:58 user nova-compute[74261]: WARNING nova.compute.manager [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 17 11:39:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:39:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:39:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Hypervisor/Node resource view: name=user free_ram=10963MB free_disk=26.285018920898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:39:58 user nova-compute[74261]: WARNING nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] No compute node record for user:d51b7aad-e6a4-40b3-931d-8430348db4c8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d51b7aad-e6a4-40b3-931d-8430348db4c8 could not be found.
Oct 17 11:39:58 user nova-compute[74261]: INFO nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Compute node record created for user:user with uuid: d51b7aad-e6a4-40b3-931d-8430348db4c8
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:39:58 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:39:59 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] [req-977aeadc-98de-4d95-9911-8f398d699edc] Created resource provider record via placement API for resource provider with UUID d51b7aad-e6a4-40b3-931d-8430348db4c8 and name user.
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74261) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 17 11:39:59 user nova-compute[74261]: INFO nova.virt.libvirt.host [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] kernel doesn't support AMD SEV
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Libvirt baseline CPU <cpu>
Oct 17 11:39:59 user nova-compute[74261]:   <arch>x86_64</arch>
Oct 17 11:39:59 user nova-compute[74261]:   <model>Nehalem</model>
Oct 17 11:39:59 user nova-compute[74261]:   <vendor>Intel</vendor>
Oct 17 11:39:59 user nova-compute[74261]:   <topology sockets="6" cores="1" threads="1"/>
Oct 17 11:39:59 user nova-compute[74261]: </cpu>
Oct 17 11:39:59 user nova-compute[74261]:  {{(pid=74261) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Updated inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Updating resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 generation from 0 to 1 during operation: update_inventory {{(pid=74261) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Updating resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 generation from 1 to 2 during operation: update_traits {{(pid=74261) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.service [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Creating RPC server for service compute {{(pid=74261) start /opt/stack/nova/nova/service.py:182}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.service [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] Join ServiceGroup membership for this service compute {{(pid=74261) start /opt/stack/nova/nova/service.py:199}}
Oct 17 11:39:59 user nova-compute[74261]: DEBUG nova.servicegroup.drivers.db [None req-60231b33-94bd-47de-aedd-dbc57562f606 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74261) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 17 11:40:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:40:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:40:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=10402MB free_disk=26.188739776611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:40:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 11:41:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:41:52 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:41:52 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=10325MB free_disk=26.252620697021484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:41:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:42:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:42:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:42:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 11:42:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:42:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:42:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:42:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:42:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=10292MB free_disk=26.006359100341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:42:55 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:42:55 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:42:55 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:42:55 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:42:55 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:42:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:43:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:43:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:43:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 11:43:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:43:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:43:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:43:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9597MB free_disk=26.026092529296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:43:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:43:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:43:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:43:57 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:43:57 user nova-compute[74261]: INFO nova.compute.claims [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Claim successful on node user
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.778s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:43:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:43:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Creating image(s)
Oct 17 11:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "/opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "/opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "/opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:43:59 user nova-compute[74261]: DEBUG nova.policy [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bf90277d773477eb663a3a96f1cdc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbde52958424fc2a4d69eee128c595d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:43:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:43:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.part --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:43:59 user nova-compute[74261]: DEBUG nova.virt.images [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] 2b60d4df-2b06-4b78-b4ef-1c17d613f5c0 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:43:59 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:43:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.part /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.part /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.converted" returned: 0 in 0.378s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.532s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:00 user nova-compute[74261]: INFO oslo.privsep.daemon [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps9o4eey1/privsep.sock']
Oct 17 11:44:00 user sudo[83522]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps9o4eey1/privsep.sock
Oct 17 11:44:00 user sudo[83522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 17 11:44:01 user sudo[83522]: pam_unix(sudo:session): session closed for user root
Oct 17 11:44:01 user nova-compute[74261]: INFO oslo.privsep.daemon [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Spawned new privsep daemon via rootwrap
Oct 17 11:44:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 17 11:44:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 17 11:44:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 17 11:44:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83525
Oct 17 11:44:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk 1073741824" returned: 0 in 0.045s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Successfully created port: 0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Cannot resize image /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Ensure instance console log exists: /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:04 user nova-compute[74261]: INFO nova.compute.claims [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Claim successful on node user
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.network.neutron [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:04 user nova-compute[74261]: INFO nova.compute.claims [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Claim successful on node user
Oct 17 11:44:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:05 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Creating image(s)
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "/opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "/opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.policy [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f29e0ea554e49c6b7ea83629e0f88c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92694390284b84b82715d4086494e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Successfully updated port: 0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquired lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:05 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk 1073741824" returned: 0 in 0.047s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:05 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Creating image(s)
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "/opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "/opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "/opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.policy [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57dc5550d0fb4f0f8aaf2633b1ad6095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8bd718919439f8a804d2b74561f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.158s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-changed-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Refreshing instance network info cache due to event network-changed-0ba8688f-956b-4db7-81e5-41366eec22db. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] Acquiring lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Cannot resize image /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Ensure instance console log exists: /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk 1073741824" returned: 0 in 0.050s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:06 user nova-compute[74261]: INFO nova.compute.claims [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Claim successful on node user
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Cannot resize image /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Ensure instance console log exists: /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updating instance_info_cache with network_info: [{"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Creating image(s)
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Releasing lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Instance network_info: |[{"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] Acquired lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Refreshing network info cache for port 0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Start _get_guest_xml network_info=[{"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.policy [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68be85de4b2e4f4d8ac32f8e62abda04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd586c830e4974cb8b3fcb758675e7014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:06 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:06 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1175586043',display_name='tempest-DeleteServersTestJSON-server-1175586043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1175586043',id=1,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcbde52958424fc2a4d69eee128c595d',ramdisk_id='',reservation_id='r-rp5p5emr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-233391474',owner_user_name='tempest-DeleteServersTestJSON-233391474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:43:59Z,user_data=None,user_id='5bf90277d773477eb663a3a96f1cdc21',uuid=f92dc0ae-f230-43b3-8020-1e22ccb1d491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Converting VIF {"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lazy-loading 'pci_devices' on Instance uuid f92dc0ae-f230-43b3-8020-1e22ccb1d491 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.205s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:06 user nova-compute[74261]:   <uuid>f92dc0ae-f230-43b3-8020-1e22ccb1d491</uuid>
Oct 17 11:44:06 user nova-compute[74261]:   <name>instance-00000001</name>
Oct 17 11:44:06 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:06 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:06 user nova-compute[74261]:   <metadata>
Oct 17 11:44:06 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:06 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:06 user nova-compute[74261]:       <nova:name>tempest-DeleteServersTestJSON-server-1175586043</nova:name>
Oct 17 11:44:06 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:06</nova:creationTime>
Oct 17 11:44:06 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:06 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:06 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:06 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:user uuid="5bf90277d773477eb663a3a96f1cdc21">tempest-DeleteServersTestJSON-233391474-project-member</nova:user>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:project uuid="fcbde52958424fc2a4d69eee128c595d">tempest-DeleteServersTestJSON-233391474</nova:project>
Oct 17 11:44:06 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:06 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:06 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:06 user nova-compute[74261]:         <nova:port uuid="0ba8688f-956b-4db7-81e5-41366eec22db">
Oct 17 11:44:06 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 11:44:06 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:06 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:06 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:06 user nova-compute[74261]:   </metadata>
Oct 17 11:44:06 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:06 user nova-compute[74261]:     <system>
Oct 17 11:44:06 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:06 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:06 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:06 user nova-compute[74261]:       <entry name="serial">f92dc0ae-f230-43b3-8020-1e22ccb1d491</entry>
Oct 17 11:44:06 user nova-compute[74261]:       <entry name="uuid">f92dc0ae-f230-43b3-8020-1e22ccb1d491</entry>
Oct 17 11:44:06 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:06 user nova-compute[74261]:     </system>
Oct 17 11:44:06 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:06 user nova-compute[74261]:   <os>
Oct 17 11:44:06 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:06 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:06 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:06 user nova-compute[74261]:   </os>
Oct 17 11:44:06 user nova-compute[74261]:   <features>
Oct 17 11:44:06 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:06 user nova-compute[74261]:     <apic/>
Oct 17 11:44:06 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:06 user nova-compute[74261]:   </features>
Oct 17 11:44:06 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:06 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:06 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:06 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:06 user nova-compute[74261]:   </clock>
Oct 17 11:44:06 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:06 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:06 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:06 user nova-compute[74261]:   </cpu>
Oct 17 11:44:06 user nova-compute[74261]:   <devices>
Oct 17 11:44:06 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:06 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:06 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk"/>
Oct 17 11:44:06 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:06 user nova-compute[74261]:     </disk>
Oct 17 11:44:06 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:06 user nova-compute[74261]:       <mac address="fa:16:3e:fc:42:79"/>
Oct 17 11:44:06 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:06 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:06 user nova-compute[74261]:       <target dev="tap0ba8688f-95"/>
Oct 17 11:44:06 user nova-compute[74261]:     </interface>
Oct 17 11:44:06 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:06 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/console.log" append="off"/>
Oct 17 11:44:06 user nova-compute[74261]:     </serial>
Oct 17 11:44:06 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:06 user nova-compute[74261]:     <video>
Oct 17 11:44:06 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:06 user nova-compute[74261]:     </video>
Oct 17 11:44:06 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:06 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:06 user nova-compute[74261]:     </rng>
Oct 17 11:44:06 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:06 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:06 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:06 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:06 user nova-compute[74261]:   </devices>
Oct 17 11:44:06 user nova-compute[74261]: </domain>
Oct 17 11:44:06 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1175586043',display_name='tempest-DeleteServersTestJSON-server-1175586043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1175586043',id=1,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcbde52958424fc2a4d69eee128c595d',ramdisk_id='',reservation_id='r-rp5p5emr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-233391474',owner_user_name='tempest-DeleteServersTestJSON-233391474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:43:59Z,user_data=None,user_id='5bf90277d773477eb663a3a96f1cdc21',uuid=f92dc0ae-f230-43b3-8020-1e22ccb1d491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Converting VIF {"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:06 user nova-compute[74261]: DEBUG os_vif [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Created schema index Interface.name {{(pid=74261) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Created schema index Port.name {{(pid=74261) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Created schema index Bridge.name {{(pid=74261) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [POLLOUT] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.304s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb9889a2-a529-5149-b6ab-64e1b7c82c26', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk 1073741824" returned: 0 in 0.057s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:07 user nova-compute[74261]: INFO oslo.privsep.daemon [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpa_r5fj07/privsep.sock']
Oct 17 11:44:07 user sudo[83598]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpa_r5fj07/privsep.sock
Oct 17 11:44:07 user sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.270s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Cannot resize image /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Ensure instance console log exists: /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Successfully created port: 201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Successfully created port: 13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updated VIF entry in instance network info cache for port 0ba8688f-956b-4db7-81e5-41366eec22db. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updating instance_info_cache with network_info: [{"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9def3246-858f-434f-bd3a-e60df2bc8769 req-dafb920d-b2b7-402e-bb18-fea9b38260db service nova] Releasing lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:08 user sudo[83598]: pam_unix(sudo:session): session closed for user root
Oct 17 11:44:08 user nova-compute[74261]: INFO oslo.privsep.daemon [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Spawned new privsep daemon via rootwrap
Oct 17 11:44:08 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 17 11:44:08 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 17 11:44:08 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 17 11:44:08 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83606
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ba8688f-95, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ba8688f-95, col_values=(('qos', UUID('45d539e2-d2cc-443c-9ad5-69506a2feda5')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ba8688f-95, col_values=(('external_ids', {'iface-id': '0ba8688f-956b-4db7-81e5-41366eec22db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:42:79', 'vm-uuid': 'f92dc0ae-f230-43b3-8020-1e22ccb1d491'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:09 user nova-compute[74261]: INFO os_vif [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95')
Oct 17 11:44:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] No VIF found with MAC fa:16:3e:fc:42:79, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Successfully created port: 7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:10 user nova-compute[74261]: INFO nova.compute.claims [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Claim successful on node user
Oct 17 11:44:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Successfully updated port: 201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:11 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-changed-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Refreshing instance network info cache due to event network-changed-201cf343-4cde-41f1-b5c3-166f7583eb1d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:11 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Creating image(s)
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:11 user nova-compute[74261]: INFO nova.compute.claims [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Claim successful on node user
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Successfully updated port: 13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.policy [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f0a17cbf46d422899c2dad6b8000fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ac99ae6b44e43ab599e1731d79b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk 1073741824" returned: 0 in 0.073s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquired lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-changed-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Refreshing instance network info cache due to event network-changed-13c59e2e-eebd-4a1e-87da-6ad926c4e716. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] Acquiring lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:12 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Cannot resize image /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Ensure instance console log exists: /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:12 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Creating image(s)
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "/opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "/opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "/opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:12 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Instance spawned successfully.
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.policy [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3715fef81bd7489b99988481ad3370db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d228de3ac0d4302ae6c0faeccd193da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:12 user nova-compute[74261]: INFO nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Took 13.91 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.247s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Instance network_info: |[{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Refreshing network info cache for port 201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Start _get_guest_xml network_info=[{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:12 user nova-compute[74261]: INFO nova.compute.manager [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Took 15.58 seconds to build instance.
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff352252-888f-4e65-88f0-8acb33e0f0ea tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.831s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk 1073741824" returned: 0 in 0.076s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2051220957',display_name='tempest-ServerActionsTestOtherA-server-2051220957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2051220957',id=2,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-3kr402p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=f0f6a950-d984-4ece-9a20-134bf800db37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.objects.instance [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'pci_devices' on Instance uuid f0f6a950-d984-4ece-9a20-134bf800db37 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:13 user nova-compute[74261]:   <uuid>f0f6a950-d984-4ece-9a20-134bf800db37</uuid>
Oct 17 11:44:13 user nova-compute[74261]:   <name>instance-00000002</name>
Oct 17 11:44:13 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:13 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:13 user nova-compute[74261]:   <metadata>
Oct 17 11:44:13 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:13 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:name>tempest-ServerActionsTestOtherA-server-2051220957</nova:name>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:12</nova:creationTime>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:13 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:13 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:user uuid="4f29e0ea554e49c6b7ea83629e0f88c6">tempest-ServerActionsTestOtherA-203196858-project-member</nova:user>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:project uuid="8e92694390284b84b82715d4086494e9">tempest-ServerActionsTestOtherA-203196858</nova:project>
Oct 17 11:44:13 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:port uuid="201cf343-4cde-41f1-b5c3-166f7583eb1d">
Oct 17 11:44:13 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 11:44:13 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:13 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:13 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:13 user nova-compute[74261]:   </metadata>
Oct 17 11:44:13 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:13 user nova-compute[74261]:     <system>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="serial">f0f6a950-d984-4ece-9a20-134bf800db37</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="uuid">f0f6a950-d984-4ece-9a20-134bf800db37</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:13 user nova-compute[74261]:     </system>
Oct 17 11:44:13 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:13 user nova-compute[74261]:   <os>
Oct 17 11:44:13 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:13 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:13 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:13 user nova-compute[74261]:   </os>
Oct 17 11:44:13 user nova-compute[74261]:   <features>
Oct 17 11:44:13 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:13 user nova-compute[74261]:     <apic/>
Oct 17 11:44:13 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:13 user nova-compute[74261]:   </features>
Oct 17 11:44:13 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:13 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:13 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:13 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:13 user nova-compute[74261]:   </clock>
Oct 17 11:44:13 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:13 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:13 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:13 user nova-compute[74261]:   </cpu>
Oct 17 11:44:13 user nova-compute[74261]:   <devices>
Oct 17 11:44:13 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:13 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:13 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk"/>
Oct 17 11:44:13 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:13 user nova-compute[74261]:     </disk>
Oct 17 11:44:13 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:13 user nova-compute[74261]:       <mac address="fa:16:3e:29:de:97"/>
Oct 17 11:44:13 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:13 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:13 user nova-compute[74261]:       <target dev="tap201cf343-4c"/>
Oct 17 11:44:13 user nova-compute[74261]:     </interface>
Oct 17 11:44:13 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:13 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/console.log" append="off"/>
Oct 17 11:44:13 user nova-compute[74261]:     </serial>
Oct 17 11:44:13 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:13 user nova-compute[74261]:     <video>
Oct 17 11:44:13 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:13 user nova-compute[74261]:     </video>
Oct 17 11:44:13 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:13 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:13 user nova-compute[74261]:     </rng>
Oct 17 11:44:13 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:13 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:13 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:13 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:13 user nova-compute[74261]:   </devices>
Oct 17 11:44:13 user nova-compute[74261]: </domain>
Oct 17 11:44:13 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2051220957',display_name='tempest-ServerActionsTestOtherA-server-2051220957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2051220957',id=2,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-3kr402p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=f0f6a950-d984-4ece-9a20-134bf800db37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG os_vif [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f9c3ed1-243a-5dc7-bc92-89e76ab1bb00', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201cf343-4c, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap201cf343-4c, col_values=(('qos', UUID('0c041a6e-8ddc-4024-a4ec-e3f3ee31b6cd')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap201cf343-4c, col_values=(('external_ids', {'iface-id': '201cf343-4cde-41f1-b5c3-166f7583eb1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:de:97', 'vm-uuid': 'f0f6a950-d984-4ece-9a20-134bf800db37'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: INFO os_vif [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c')
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.252s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No VIF found with MAC fa:16:3e:29:de:97, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Successfully updated port: 7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Updating instance_info_cache with network_info: [{"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Releasing lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Instance network_info: |[{"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Cannot resize image /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Ensure instance console log exists: /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] Acquired lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Refreshing network info cache for port 13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Start _get_guest_xml network_info=[{"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-949048204',display_name='tempest-ServersNegativeTestJSON-server-949048204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-949048204',id=3,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8bd718919439f8a804d2b74561f1d',ramdisk_id='',reservation_id='r-mxnw3ho9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086864809',owner_user_name='tempest-ServersNegativeTestJSON-1086864809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:05Z,user_data=None,user_id='57dc5550d0fb4f0f8aaf2633b1ad6095',uuid=f75b961a-6dc8-496f-b5e0-4c8967cc991d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converting VIF {"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.objects.instance [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lazy-loading 'pci_devices' on Instance uuid f75b961a-6dc8-496f-b5e0-4c8967cc991d {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing instance network info cache due to event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:13 user nova-compute[74261]:   <uuid>f75b961a-6dc8-496f-b5e0-4c8967cc991d</uuid>
Oct 17 11:44:13 user nova-compute[74261]:   <name>instance-00000003</name>
Oct 17 11:44:13 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:13 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:13 user nova-compute[74261]:   <metadata>
Oct 17 11:44:13 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:13 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:name>tempest-ServersNegativeTestJSON-server-949048204</nova:name>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:13</nova:creationTime>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:13 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:13 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:user uuid="57dc5550d0fb4f0f8aaf2633b1ad6095">tempest-ServersNegativeTestJSON-1086864809-project-member</nova:user>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:project uuid="a7c8bd718919439f8a804d2b74561f1d">tempest-ServersNegativeTestJSON-1086864809</nova:project>
Oct 17 11:44:13 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:13 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:13 user nova-compute[74261]:         <nova:port uuid="13c59e2e-eebd-4a1e-87da-6ad926c4e716">
Oct 17 11:44:13 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 11:44:13 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:13 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:13 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:13 user nova-compute[74261]:   </metadata>
Oct 17 11:44:13 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:13 user nova-compute[74261]:     <system>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="serial">f75b961a-6dc8-496f-b5e0-4c8967cc991d</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="uuid">f75b961a-6dc8-496f-b5e0-4c8967cc991d</entry>
Oct 17 11:44:13 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:13 user nova-compute[74261]:     </system>
Oct 17 11:44:13 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:13 user nova-compute[74261]:   <os>
Oct 17 11:44:13 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:13 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:13 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:13 user nova-compute[74261]:   </os>
Oct 17 11:44:13 user nova-compute[74261]:   <features>
Oct 17 11:44:13 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:13 user nova-compute[74261]:     <apic/>
Oct 17 11:44:13 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:13 user nova-compute[74261]:   </features>
Oct 17 11:44:13 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:13 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:13 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:13 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:13 user nova-compute[74261]:   </clock>
Oct 17 11:44:13 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:13 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:13 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:13 user nova-compute[74261]:   </cpu>
Oct 17 11:44:13 user nova-compute[74261]:   <devices>
Oct 17 11:44:13 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:13 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:13 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk"/>
Oct 17 11:44:13 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:13 user nova-compute[74261]:     </disk>
Oct 17 11:44:13 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:13 user nova-compute[74261]:       <mac address="fa:16:3e:92:0c:b0"/>
Oct 17 11:44:13 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:13 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:13 user nova-compute[74261]:       <target dev="tap13c59e2e-ee"/>
Oct 17 11:44:13 user nova-compute[74261]:     </interface>
Oct 17 11:44:13 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:13 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/console.log" append="off"/>
Oct 17 11:44:13 user nova-compute[74261]:     </serial>
Oct 17 11:44:13 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:13 user nova-compute[74261]:     <video>
Oct 17 11:44:13 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:13 user nova-compute[74261]:     </video>
Oct 17 11:44:13 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:13 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:13 user nova-compute[74261]:     </rng>
Oct 17 11:44:13 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:13 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:13 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:13 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:13 user nova-compute[74261]:   </devices>
Oct 17 11:44:13 user nova-compute[74261]: </domain>
Oct 17 11:44:13 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-949048204',display_name='tempest-ServersNegativeTestJSON-server-949048204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-949048204',id=3,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8bd718919439f8a804d2b74561f1d',ramdisk_id='',reservation_id='r-mxnw3ho9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086864809',owner_user_name='tempest-ServersNegativeTestJSON-1086864809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:05Z,user_data=None,user_id='57dc5550d0fb4f0f8aaf2633b1ad6095',uuid=f75b961a-6dc8-496f-b5e0-4c8967cc991d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converting VIF {"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG os_vif [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d44c863-280c-5448-bb3e-8dcc086daea1', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c59e2e-ee, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13c59e2e-ee, col_values=(('qos', UUID('4dc53feb-dff0-4717-801c-2ffc9d4f63cf')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13c59e2e-ee, col_values=(('external_ids', {'iface-id': '13c59e2e-eebd-4a1e-87da-6ad926c4e716', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:0c:b0', 'vm-uuid': 'f75b961a-6dc8-496f-b5e0-4c8967cc991d'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:13 user nova-compute[74261]: INFO os_vif [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee')
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] No VIF found with MAC fa:16:3e:92:0c:b0, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Successfully created port: eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updated VIF entry in instance network info cache for port 201cf343-4cde-41f1-b5c3-166f7583eb1d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-252cf365-6942-405a-aa58-2e9617813e02 req-1b1a723e-da41-4784-bca0-05f52ff43f91 service nova] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance network_info: |[{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Start _get_guest_xml network_info=[{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-103165328',display_name='tempest-ServerStableDeviceRescueTest-server-103165328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-103165328',id=4,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlEf7+UCLSnqPt4PKh90e106AvNKjFXQiuFNpfY7AvzpEigsAoqR2ZVklvDCW0gT2Po9SnkkBWVgCY3j/+bYFs8wuzd1kue6eGFu2ZmzTtUhUJm/SvDqwbrwYXwtBsatQ==',key_name='tempest-keypair-120172596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d586c830e4974cb8b3fcb758675e7014',ramdisk_id='',reservation_id='r-495hwwnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-895463564',owner_user_name='tempest-ServerStableDeviceRescueTest-895463564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68be85de4b2e4f4d8ac32f8e62abda04',uuid=f07110f1-a355-47f2-9243-620b6ca41584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converting VIF {"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'pci_devices' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:15 user nova-compute[74261]:   <uuid>f07110f1-a355-47f2-9243-620b6ca41584</uuid>
Oct 17 11:44:15 user nova-compute[74261]:   <name>instance-00000004</name>
Oct 17 11:44:15 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:15 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:15 user nova-compute[74261]:   <metadata>
Oct 17 11:44:15 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:15 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:15 user nova-compute[74261]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-103165328</nova:name>
Oct 17 11:44:15 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:14</nova:creationTime>
Oct 17 11:44:15 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:15 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:15 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:15 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:user uuid="68be85de4b2e4f4d8ac32f8e62abda04">tempest-ServerStableDeviceRescueTest-895463564-project-member</nova:user>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:project uuid="d586c830e4974cb8b3fcb758675e7014">tempest-ServerStableDeviceRescueTest-895463564</nova:project>
Oct 17 11:44:15 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:15 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:15 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:15 user nova-compute[74261]:         <nova:port uuid="7f10f299-2636-4403-80bf-e128689cdc4e">
Oct 17 11:44:15 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:44:15 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:15 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:15 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:15 user nova-compute[74261]:   </metadata>
Oct 17 11:44:15 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:15 user nova-compute[74261]:     <system>
Oct 17 11:44:15 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:15 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:15 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:15 user nova-compute[74261]:       <entry name="serial">f07110f1-a355-47f2-9243-620b6ca41584</entry>
Oct 17 11:44:15 user nova-compute[74261]:       <entry name="uuid">f07110f1-a355-47f2-9243-620b6ca41584</entry>
Oct 17 11:44:15 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:15 user nova-compute[74261]:     </system>
Oct 17 11:44:15 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:15 user nova-compute[74261]:   <os>
Oct 17 11:44:15 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:15 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:15 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:15 user nova-compute[74261]:   </os>
Oct 17 11:44:15 user nova-compute[74261]:   <features>
Oct 17 11:44:15 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:15 user nova-compute[74261]:     <apic/>
Oct 17 11:44:15 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:15 user nova-compute[74261]:   </features>
Oct 17 11:44:15 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:15 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:15 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:15 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:15 user nova-compute[74261]:   </clock>
Oct 17 11:44:15 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:15 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:15 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:15 user nova-compute[74261]:   </cpu>
Oct 17 11:44:15 user nova-compute[74261]:   <devices>
Oct 17 11:44:15 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:15 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:15 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk"/>
Oct 17 11:44:15 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:15 user nova-compute[74261]:     </disk>
Oct 17 11:44:15 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:15 user nova-compute[74261]:       <mac address="fa:16:3e:38:0c:0e"/>
Oct 17 11:44:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:15 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:15 user nova-compute[74261]:       <target dev="tap7f10f299-26"/>
Oct 17 11:44:15 user nova-compute[74261]:     </interface>
Oct 17 11:44:15 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:15 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/console.log" append="off"/>
Oct 17 11:44:15 user nova-compute[74261]:     </serial>
Oct 17 11:44:15 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:15 user nova-compute[74261]:     <video>
Oct 17 11:44:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:15 user nova-compute[74261]:     </video>
Oct 17 11:44:15 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:15 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:15 user nova-compute[74261]:     </rng>
Oct 17 11:44:15 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:15 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:15 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:15 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:15 user nova-compute[74261]:   </devices>
Oct 17 11:44:15 user nova-compute[74261]: </domain>
Oct 17 11:44:15 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-103165328',display_name='tempest-ServerStableDeviceRescueTest-server-103165328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-103165328',id=4,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlEf7+UCLSnqPt4PKh90e106AvNKjFXQiuFNpfY7AvzpEigsAoqR2ZVklvDCW0gT2Po9SnkkBWVgCY3j/+bYFs8wuzd1kue6eGFu2ZmzTtUhUJm/SvDqwbrwYXwtBsatQ==',key_name='tempest-keypair-120172596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d586c830e4974cb8b3fcb758675e7014',ramdisk_id='',reservation_id='r-495hwwnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-895463564',owner_user_name='tempest-ServerStableDeviceRescueTest-895463564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68be85de4b2e4f4d8ac32f8e62abda04',uuid=f07110f1-a355-47f2-9243-620b6ca41584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converting VIF {"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG os_vif [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f027b503-5b28-5ee5-8869-38756cec0d35', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f10f299-26, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f10f299-26, col_values=(('qos', UUID('f3949a3d-fd66-44c7-b1f3-295a0e5e8eaf')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f10f299-26, col_values=(('external_ids', {'iface-id': '7f10f299-2636-4403-80bf-e128689cdc4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:0c:0e', 'vm-uuid': 'f07110f1-a355-47f2-9243-620b6ca41584'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: INFO os_vif [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26')
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No VIF found with MAC fa:16:3e:38:0c:0e, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Updated VIF entry in instance network info cache for port 13c59e2e-eebd-4a1e-87da-6ad926c4e716. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Updating instance_info_cache with network_info: [{"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-44439bd0-bf07-4abe-b869-0dd6c8ee7dfe req-43e9f861-2a20-4eab-a611-a4f9b41d0976 service nova] Releasing lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Successfully created port: af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updated VIF entry in instance network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3a573b0f-2d0a-4f6b-becb-6477d5470885 req-55ef6aa5-2e21-4263-acb2-94c7c0b98da3 service nova] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Successfully updated port: eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquired lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-changed-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Refreshing instance network info cache due to event network-changed-eb17ef68-792f-4ebb-aff8-d18cb41cb992. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] Acquiring lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Successfully updated port: af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-changed-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Refreshing instance network info cache due to event network-changed-af15dff2-7dd0-449e-9cfa-9ae2135a43d4. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updating instance_info_cache with network_info: [{"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Releasing lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Instance network_info: |[{"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] Acquired lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Refreshing network info cache for port eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Start _get_guest_xml network_info=[{"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1775373920',display_name='tempest-ServerActionsTestOtherB-server-1775373920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1775373920',id=6,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD43oez7iXtXpmEHy0pGJh6/aiWEr34F1mNahsepZ9wK/OIeyWZlnYMBk+RnpUdGd94QnXxPAR2Z8mdLi6S188TTfXPgMIN4XRoGzeRBfLWIMJ0kEG/8DuepEadTxBl8yg==',key_name='tempest-keypair-880199744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d228de3ac0d4302ae6c0faeccd193da',ramdisk_id='',reservation_id='r-78h3s10u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-99003794',owner_user_name='tempest-ServerActionsTestOtherB-99003794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3715fef81bd7489b99988481ad3370db',uuid=6873f406-8c93-4d9d-b0d5-92296614b94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Converting VIF {"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.objects.instance [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lazy-loading 'pci_devices' on Instance uuid 6873f406-8c93-4d9d-b0d5-92296614b94b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:17 user nova-compute[74261]:   <uuid>6873f406-8c93-4d9d-b0d5-92296614b94b</uuid>
Oct 17 11:44:17 user nova-compute[74261]:   <name>instance-00000006</name>
Oct 17 11:44:17 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:17 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:17 user nova-compute[74261]:   <metadata>
Oct 17 11:44:17 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:17 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:name>tempest-ServerActionsTestOtherB-server-1775373920</nova:name>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:17</nova:creationTime>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:17 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:17 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:user uuid="3715fef81bd7489b99988481ad3370db">tempest-ServerActionsTestOtherB-99003794-project-member</nova:user>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:project uuid="7d228de3ac0d4302ae6c0faeccd193da">tempest-ServerActionsTestOtherB-99003794</nova:project>
Oct 17 11:44:17 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:port uuid="eb17ef68-792f-4ebb-aff8-d18cb41cb992">
Oct 17 11:44:17 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 17 11:44:17 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:17 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:17 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:17 user nova-compute[74261]:   </metadata>
Oct 17 11:44:17 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:17 user nova-compute[74261]:     <system>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="serial">6873f406-8c93-4d9d-b0d5-92296614b94b</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="uuid">6873f406-8c93-4d9d-b0d5-92296614b94b</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:17 user nova-compute[74261]:     </system>
Oct 17 11:44:17 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:17 user nova-compute[74261]:   <os>
Oct 17 11:44:17 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:17 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:17 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:17 user nova-compute[74261]:   </os>
Oct 17 11:44:17 user nova-compute[74261]:   <features>
Oct 17 11:44:17 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:17 user nova-compute[74261]:     <apic/>
Oct 17 11:44:17 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:17 user nova-compute[74261]:   </features>
Oct 17 11:44:17 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:17 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:17 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:17 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:17 user nova-compute[74261]:   </clock>
Oct 17 11:44:17 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:17 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:17 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:17 user nova-compute[74261]:   </cpu>
Oct 17 11:44:17 user nova-compute[74261]:   <devices>
Oct 17 11:44:17 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:17 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:17 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk"/>
Oct 17 11:44:17 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:17 user nova-compute[74261]:     </disk>
Oct 17 11:44:17 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:17 user nova-compute[74261]:       <mac address="fa:16:3e:82:71:fe"/>
Oct 17 11:44:17 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:17 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:17 user nova-compute[74261]:       <target dev="tapeb17ef68-79"/>
Oct 17 11:44:17 user nova-compute[74261]:     </interface>
Oct 17 11:44:17 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:17 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/console.log" append="off"/>
Oct 17 11:44:17 user nova-compute[74261]:     </serial>
Oct 17 11:44:17 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:17 user nova-compute[74261]:     <video>
Oct 17 11:44:17 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:17 user nova-compute[74261]:     </video>
Oct 17 11:44:17 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:17 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:17 user nova-compute[74261]:     </rng>
Oct 17 11:44:17 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:17 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:17 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:17 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:17 user nova-compute[74261]:   </devices>
Oct 17 11:44:17 user nova-compute[74261]: </domain>
Oct 17 11:44:17 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1775373920',display_name='tempest-ServerActionsTestOtherB-server-1775373920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1775373920',id=6,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD43oez7iXtXpmEHy0pGJh6/aiWEr34F1mNahsepZ9wK/OIeyWZlnYMBk+RnpUdGd94QnXxPAR2Z8mdLi6S188TTfXPgMIN4XRoGzeRBfLWIMJ0kEG/8DuepEadTxBl8yg==',key_name='tempest-keypair-880199744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d228de3ac0d4302ae6c0faeccd193da',ramdisk_id='',reservation_id='r-78h3s10u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-99003794',owner_user_name='tempest-ServerActionsTestOtherB-99003794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3715fef81bd7489b99988481ad3370db',uuid=6873f406-8c93-4d9d-b0d5-92296614b94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Converting VIF {"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG os_vif [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06e1b7e5-b6c4-5da0-8510-dcef83ca890f', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb17ef68-79, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb17ef68-79, col_values=(('qos', UUID('942913e5-f6f5-45f4-9154-86e29e7ed538')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb17ef68-79, col_values=(('external_ids', {'iface-id': 'eb17ef68-792f-4ebb-aff8-d18cb41cb992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:71:fe', 'vm-uuid': '6873f406-8c93-4d9d-b0d5-92296614b94b'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: INFO os_vif [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79')
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] No VIF found with MAC fa:16:3e:82:71:fe, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance network_info: |[{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.neutron [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Refreshing network info cache for port af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start _get_guest_xml network_info=[{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.objects.instance [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'pci_devices' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:17 user nova-compute[74261]:   <uuid>93fe26e6-4a68-4976-b53c-3c33250c20de</uuid>
Oct 17 11:44:17 user nova-compute[74261]:   <name>instance-00000005</name>
Oct 17 11:44:17 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:17 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:17 user nova-compute[74261]:   <metadata>
Oct 17 11:44:17 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:17 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeTestJSON-server-1703914465</nova:name>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:17</nova:creationTime>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:17 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:17 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:user uuid="0f0a17cbf46d422899c2dad6b8000fb3">tempest-AttachVolumeTestJSON-1691828841-project-member</nova:user>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:project uuid="743ac99ae6b44e43ab599e1731d79b3b">tempest-AttachVolumeTestJSON-1691828841</nova:project>
Oct 17 11:44:17 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:17 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:17 user nova-compute[74261]:         <nova:port uuid="af15dff2-7dd0-449e-9cfa-9ae2135a43d4">
Oct 17 11:44:17 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 11:44:17 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:17 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:17 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:17 user nova-compute[74261]:   </metadata>
Oct 17 11:44:17 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:17 user nova-compute[74261]:     <system>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="serial">93fe26e6-4a68-4976-b53c-3c33250c20de</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="uuid">93fe26e6-4a68-4976-b53c-3c33250c20de</entry>
Oct 17 11:44:17 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:17 user nova-compute[74261]:     </system>
Oct 17 11:44:17 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:17 user nova-compute[74261]:   <os>
Oct 17 11:44:17 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:17 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:17 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:17 user nova-compute[74261]:   </os>
Oct 17 11:44:17 user nova-compute[74261]:   <features>
Oct 17 11:44:17 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:17 user nova-compute[74261]:     <apic/>
Oct 17 11:44:17 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:17 user nova-compute[74261]:   </features>
Oct 17 11:44:17 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:17 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:17 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:17 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:17 user nova-compute[74261]:   </clock>
Oct 17 11:44:17 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:17 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:17 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:17 user nova-compute[74261]:   </cpu>
Oct 17 11:44:17 user nova-compute[74261]:   <devices>
Oct 17 11:44:17 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:17 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:17 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk"/>
Oct 17 11:44:17 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:17 user nova-compute[74261]:     </disk>
Oct 17 11:44:17 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:17 user nova-compute[74261]:       <mac address="fa:16:3e:83:f7:64"/>
Oct 17 11:44:17 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:17 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:17 user nova-compute[74261]:       <target dev="tapaf15dff2-7d"/>
Oct 17 11:44:17 user nova-compute[74261]:     </interface>
Oct 17 11:44:17 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:17 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/console.log" append="off"/>
Oct 17 11:44:17 user nova-compute[74261]:     </serial>
Oct 17 11:44:17 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:17 user nova-compute[74261]:     <video>
Oct 17 11:44:17 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:17 user nova-compute[74261]:     </video>
Oct 17 11:44:17 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:17 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:17 user nova-compute[74261]:     </rng>
Oct 17 11:44:17 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:17 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:17 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:17 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:17 user nova-compute[74261]:   </devices>
Oct 17 11:44:17 user nova-compute[74261]: </domain>
Oct 17 11:44:17 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG os_vif [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '645fa193-3a41-5ffd-8cc3-6602159c63d6', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf15dff2-7d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf15dff2-7d, col_values=(('qos', UUID('865d4a6c-e576-47fc-b021-fe4d24b5e36a')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf15dff2-7d, col_values=(('external_ids', {'iface-id': 'af15dff2-7dd0-449e-9cfa-9ae2135a43d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:f7:64', 'vm-uuid': '93fe26e6-4a68-4976-b53c-3c33250c20de'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG nova.network.neutron [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updated VIF entry in instance network info cache for port eb17ef68-792f-4ebb-aff8-d18cb41cb992. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG nova.network.neutron [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updating instance_info_cache with network_info: [{"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: INFO os_vif [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d')
Oct 17 11:44:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33c319fc-cbbc-4bf8-a4ac-c8ccd9a65f23 req-2fc93aee-a9aa-442c-8d3c-9b134e3e2525 service nova] Releasing lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No VIF found with MAC fa:16:3e:83:f7:64, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updated VIF entry in instance network info cache for port af15dff2-7dd0-449e-9cfa-9ae2135a43d4. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fe38c7f8-1ba6-44ac-8423-9022657f832f req-5da73310-4f12-4245-b969-ebdf5eacfba0 service nova] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:22 user nova-compute[74261]: INFO nova.compute.claims [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Claim successful on node user
Oct 17 11:44:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Instance spawned successfully.
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:23 user nova-compute[74261]: INFO nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Took 17.57 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:23 user nova-compute[74261]: INFO nova.compute.manager [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Took 18.51 seconds to build instance.
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:23 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Instance spawned successfully.
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-abaa407b-7733-4c3c-b746-91eb3faee338 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.702s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:23 user nova-compute[74261]: INFO nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Took 18.47 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.720s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:23 user nova-compute[74261]: INFO nova.compute.manager [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Took 19.39 seconds to build instance.
Oct 17 11:44:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4cebffc3-d0c3-4083-9e79-6e68ebadcc95 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.840s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG nova.policy [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ab08ea77d1c44588ce76ec801bfa11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf4a57fa9484c8c8fc774664775226e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Creating image(s)
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "/opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "/opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.293s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.256s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk 1073741824" returned: 0 in 0.104s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.252s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Successfully created port: dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Cannot resize image /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Ensure instance console log exists: /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance spawned successfully.
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Instance spawned successfully.
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Took 19.34 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Took 13.63 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance spawned successfully.
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.compute.manager [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Took 14.72 seconds to build instance.
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.compute.manager [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Took 20.27 seconds to build instance.
Oct 17 11:44:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-01cf676f-bea7-4a85-949f-cfa979c332f7 tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.867s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0ad75c4e-b491-4aa7-b27a-bff017cbcc52 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.425s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Took 14.83 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:26 user nova-compute[74261]: INFO nova.compute.manager [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Took 15.79 seconds to build instance.
Oct 17 11:44:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ee39db6-edb2-4d16-99b2-39d306e3395e tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.934s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-6e179cdc-5c65-41ca-b23e-65ba13299886 req-cec64a44-c2ec-4ba6-913d-ef8339f8121d service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e179cdc-5c65-41ca-b23e-65ba13299886 req-cec64a44-c2ec-4ba6-913d-ef8339f8121d service nova] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e179cdc-5c65-41ca-b23e-65ba13299886 req-cec64a44-c2ec-4ba6-913d-ef8339f8121d service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e179cdc-5c65-41ca-b23e-65ba13299886 req-cec64a44-c2ec-4ba6-913d-ef8339f8121d service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-6e179cdc-5c65-41ca-b23e-65ba13299886 req-cec64a44-c2ec-4ba6-913d-ef8339f8121d service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] No waiting events found dispatching network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:27 user nova-compute[74261]: WARNING nova.compute.manager [req-6e179cdc-5c65-41ca-b23e-65ba13299886 req-cec64a44-c2ec-4ba6-913d-ef8339f8121d service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received unexpected event network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 for instance with vm_state active and task_state None.
Oct 17 11:44:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Successfully updated port: dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquired lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-changed-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Refreshing instance network info cache due to event network-changed-dfb329d0-1c06-4db5-bc81-d62689969318. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] Acquiring lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updating instance_info_cache with network_info: [{"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Releasing lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Instance network_info: |[{"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] Acquired lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.network.neutron [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Refreshing network info cache for port dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Start _get_guest_xml network_info=[{"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:29 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:29 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-471937317',display_name='tempest-VolumesAdminNegativeTest-server-471937317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-471937317',id=7,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7DBU4idqsTvb0b/70roulCG20TqHa2mNSHvWE5JFWUEqkG3hzP7FzqPcYHhxf7KgZnlJdNdLXOW54sLrqhS8HsZEBNZsEmQJiR/VznrKf98XHi46D9lWqjct2Z9atxMA==',key_name='tempest-keypair-753395369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf4a57fa9484c8c8fc774664775226e',ramdisk_id='',reservation_id='r-0t7nu652',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-593462057',owner_user_name='tempest-VolumesAdminNegativeTest-593462057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab08ea77d1c44588ce76ec801bfa11e',uuid=0a037120-c55a-4394-99f2-7c1d6e5664b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converting VIF {"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:29 user nova-compute[74261]:   <uuid>0a037120-c55a-4394-99f2-7c1d6e5664b7</uuid>
Oct 17 11:44:29 user nova-compute[74261]:   <name>instance-00000007</name>
Oct 17 11:44:29 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:29 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:29 user nova-compute[74261]:   <metadata>
Oct 17 11:44:29 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:29 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:29 user nova-compute[74261]:       <nova:name>tempest-VolumesAdminNegativeTest-server-471937317</nova:name>
Oct 17 11:44:29 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:29</nova:creationTime>
Oct 17 11:44:29 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:29 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:29 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:29 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:user uuid="3ab08ea77d1c44588ce76ec801bfa11e">tempest-VolumesAdminNegativeTest-593462057-project-member</nova:user>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:project uuid="0bf4a57fa9484c8c8fc774664775226e">tempest-VolumesAdminNegativeTest-593462057</nova:project>
Oct 17 11:44:29 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:29 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:29 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:29 user nova-compute[74261]:         <nova:port uuid="dfb329d0-1c06-4db5-bc81-d62689969318">
Oct 17 11:44:29 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:44:29 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:29 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:29 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:29 user nova-compute[74261]:   </metadata>
Oct 17 11:44:29 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:29 user nova-compute[74261]:     <system>
Oct 17 11:44:29 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:29 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:29 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:29 user nova-compute[74261]:       <entry name="serial">0a037120-c55a-4394-99f2-7c1d6e5664b7</entry>
Oct 17 11:44:29 user nova-compute[74261]:       <entry name="uuid">0a037120-c55a-4394-99f2-7c1d6e5664b7</entry>
Oct 17 11:44:29 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:29 user nova-compute[74261]:     </system>
Oct 17 11:44:29 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:29 user nova-compute[74261]:   <os>
Oct 17 11:44:29 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:29 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:29 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:29 user nova-compute[74261]:   </os>
Oct 17 11:44:29 user nova-compute[74261]:   <features>
Oct 17 11:44:29 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:29 user nova-compute[74261]:     <apic/>
Oct 17 11:44:29 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:29 user nova-compute[74261]:   </features>
Oct 17 11:44:29 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:29 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:29 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:29 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:29 user nova-compute[74261]:   </clock>
Oct 17 11:44:29 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:29 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:29 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:29 user nova-compute[74261]:   </cpu>
Oct 17 11:44:29 user nova-compute[74261]:   <devices>
Oct 17 11:44:29 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:29 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:29 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk"/>
Oct 17 11:44:29 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:29 user nova-compute[74261]:     </disk>
Oct 17 11:44:29 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:29 user nova-compute[74261]:       <mac address="fa:16:3e:9b:21:d4"/>
Oct 17 11:44:29 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:29 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:29 user nova-compute[74261]:       <target dev="tapdfb329d0-1c"/>
Oct 17 11:44:29 user nova-compute[74261]:     </interface>
Oct 17 11:44:29 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:29 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/console.log" append="off"/>
Oct 17 11:44:29 user nova-compute[74261]:     </serial>
Oct 17 11:44:29 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:29 user nova-compute[74261]:     <video>
Oct 17 11:44:29 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:29 user nova-compute[74261]:     </video>
Oct 17 11:44:29 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:29 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:29 user nova-compute[74261]:     </rng>
Oct 17 11:44:29 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:29 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:29 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:29 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:29 user nova-compute[74261]:   </devices>
Oct 17 11:44:29 user nova-compute[74261]: </domain>
Oct 17 11:44:29 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-471937317',display_name='tempest-VolumesAdminNegativeTest-server-471937317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-471937317',id=7,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7DBU4idqsTvb0b/70roulCG20TqHa2mNSHvWE5JFWUEqkG3hzP7FzqPcYHhxf7KgZnlJdNdLXOW54sLrqhS8HsZEBNZsEmQJiR/VznrKf98XHi46D9lWqjct2Z9atxMA==',key_name='tempest-keypair-753395369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf4a57fa9484c8c8fc774664775226e',ramdisk_id='',reservation_id='r-0t7nu652',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-593462057',owner_user_name='tempest-VolumesAdminNegativeTest-593462057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab08ea77d1c44588ce76ec801bfa11e',uuid=0a037120-c55a-4394-99f2-7c1d6e5664b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converting VIF {"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG os_vif [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f4218be-14c4-5ec8-8624-384247bb63ae', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfb329d0-1c, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfb329d0-1c, col_values=(('qos', UUID('895e609e-ee95-472b-b247-b3ca4106609e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfb329d0-1c, col_values=(('external_ids', {'iface-id': 'dfb329d0-1c06-4db5-bc81-d62689969318', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:21:d4', 'vm-uuid': '0a037120-c55a-4394-99f2-7c1d6e5664b7'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:29 user nova-compute[74261]: INFO os_vif [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c')
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No VIF found with MAC fa:16:3e:9b:21:d4, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-5849f14c-03ae-43fb-ba92-e69ff823b67e req-b981fe23-bd8d-406e-9109-e9b5296b6805 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5849f14c-03ae-43fb-ba92-e69ff823b67e req-b981fe23-bd8d-406e-9109-e9b5296b6805 service nova] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5849f14c-03ae-43fb-ba92-e69ff823b67e req-b981fe23-bd8d-406e-9109-e9b5296b6805 service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5849f14c-03ae-43fb-ba92-e69ff823b67e req-b981fe23-bd8d-406e-9109-e9b5296b6805 service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-5849f14c-03ae-43fb-ba92-e69ff823b67e req-b981fe23-bd8d-406e-9109-e9b5296b6805 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] No waiting events found dispatching network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:29 user nova-compute[74261]: WARNING nova.compute.manager [req-5849f14c-03ae-43fb-ba92-e69ff823b67e req-b981fe23-bd8d-406e-9109-e9b5296b6805 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received unexpected event network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 for instance with vm_state active and task_state None.
Oct 17 11:44:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updated VIF entry in instance network info cache for port dfb329d0-1c06-4db5-bc81-d62689969318. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updating instance_info_cache with network_info: [{"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-796f6111-e57f-444b-97a5-48bbf1cca047 req-9136a5a7-5c45-4582-b7ae-bdc1459a2e2b service nova] Releasing lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-a224ce10-496d-4f32-80f6-2a2035303ce3 req-e9b9ec56-a0e9-484e-911b-a42f28c27ce7 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a224ce10-496d-4f32-80f6-2a2035303ce3 req-e9b9ec56-a0e9-484e-911b-a42f28c27ce7 service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a224ce10-496d-4f32-80f6-2a2035303ce3 req-e9b9ec56-a0e9-484e-911b-a42f28c27ce7 service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a224ce10-496d-4f32-80f6-2a2035303ce3 req-e9b9ec56-a0e9-484e-911b-a42f28c27ce7 service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-a224ce10-496d-4f32-80f6-2a2035303ce3 req-e9b9ec56-a0e9-484e-911b-a42f28c27ce7 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:30 user nova-compute[74261]: WARNING nova.compute.manager [req-a224ce10-496d-4f32-80f6-2a2035303ce3 req-e9b9ec56-a0e9-484e-911b-a42f28c27ce7 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received unexpected event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with vm_state active and task_state None.
Oct 17 11:44:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-f90bc556-0962-42c8-80eb-28773facd86b req-d8551906-e3cf-4cf1-9f07-37d186651a7c service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f90bc556-0962-42c8-80eb-28773facd86b req-d8551906-e3cf-4cf1-9f07-37d186651a7c service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f90bc556-0962-42c8-80eb-28773facd86b req-d8551906-e3cf-4cf1-9f07-37d186651a7c service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f90bc556-0962-42c8-80eb-28773facd86b req-d8551906-e3cf-4cf1-9f07-37d186651a7c service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-f90bc556-0962-42c8-80eb-28773facd86b req-d8551906-e3cf-4cf1-9f07-37d186651a7c service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:32 user nova-compute[74261]: WARNING nova.compute.manager [req-f90bc556-0962-42c8-80eb-28773facd86b req-d8551906-e3cf-4cf1-9f07-37d186651a7c service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received unexpected event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with vm_state active and task_state None.
Oct 17 11:44:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-19442a3c-3cbb-493d-af0f-c9e7cd72ce30 req-7b49285d-7736-4fb7-9c13-703735ab51c3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-19442a3c-3cbb-493d-af0f-c9e7cd72ce30 req-7b49285d-7736-4fb7-9c13-703735ab51c3 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-19442a3c-3cbb-493d-af0f-c9e7cd72ce30 req-7b49285d-7736-4fb7-9c13-703735ab51c3 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-19442a3c-3cbb-493d-af0f-c9e7cd72ce30 req-7b49285d-7736-4fb7-9c13-703735ab51c3 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-19442a3c-3cbb-493d-af0f-c9e7cd72ce30 req-7b49285d-7736-4fb7-9c13-703735ab51c3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:34 user nova-compute[74261]: WARNING nova.compute.manager [req-19442a3c-3cbb-493d-af0f-c9e7cd72ce30 req-7b49285d-7736-4fb7-9c13-703735ab51c3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state active and task_state None.
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:34 user nova-compute[74261]: INFO nova.compute.claims [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Claim successful on node user
Oct 17 11:44:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Instance spawned successfully.
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.058s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:35 user nova-compute[74261]: INFO nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Took 11.20 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:35 user nova-compute[74261]: INFO nova.compute.manager [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Took 13.96 seconds to build instance.
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2346e19-d696-4c71-b0ad-864d57aa032a tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.125s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Creating image(s)
Oct 17 11:44:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "/opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "/opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "/opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "e129d60bdda9f5280c694a198f2bd2c1d1d40336" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "e129d60bdda9f5280c694a198f2bd2c1d1d40336" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-577d9252-305b-452e-9830-0cd819ddc9ef req-e3d23763-8bd4-4d44-82bc-12316004daf9 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-577d9252-305b-452e-9830-0cd819ddc9ef req-e3d23763-8bd4-4d44-82bc-12316004daf9 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-577d9252-305b-452e-9830-0cd819ddc9ef req-e3d23763-8bd4-4d44-82bc-12316004daf9 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-577d9252-305b-452e-9830-0cd819ddc9ef req-e3d23763-8bd4-4d44-82bc-12316004daf9 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-577d9252-305b-452e-9830-0cd819ddc9ef req-e3d23763-8bd4-4d44-82bc-12316004daf9 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:36 user nova-compute[74261]: WARNING nova.compute.manager [req-577d9252-305b-452e-9830-0cd819ddc9ef req-e3d23763-8bd4-4d44-82bc-12316004daf9 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state active and task_state None.
Oct 17 11:44:36 user nova-compute[74261]: DEBUG nova.policy [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67aab23b500d41b89051dce4887d9137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91912c7347042c99d8b8d31e5cc62cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-08d7bc3d-3ea2-43f9-a773-317d584edd5d req-c3db0dc3-2a42-408b-8489-6f555b9d1bed service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-08d7bc3d-3ea2-43f9-a773-317d584edd5d req-c3db0dc3-2a42-408b-8489-6f555b9d1bed service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-08d7bc3d-3ea2-43f9-a773-317d584edd5d req-c3db0dc3-2a42-408b-8489-6f555b9d1bed service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-08d7bc3d-3ea2-43f9-a773-317d584edd5d req-c3db0dc3-2a42-408b-8489-6f555b9d1bed service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-08d7bc3d-3ea2-43f9-a773-317d584edd5d req-c3db0dc3-2a42-408b-8489-6f555b9d1bed service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:36 user nova-compute[74261]: WARNING nova.compute.manager [req-08d7bc3d-3ea2-43f9-a773-317d584edd5d req-c3db0dc3-2a42-408b-8489-6f555b9d1bed service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state active and task_state None.
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.part --force-share --output=json" returned: 0 in 0.360s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG nova.virt.images [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] 54c348de-259f-4849-bcc3-a946848dbbd3 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.part /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:37 user nova-compute[74261]: INFO nova.compute.claims [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Claim successful on node user
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.part /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.converted" returned: 0 in 0.247s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336.converted --force-share --output=json" returned: 0 in 0.241s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "e129d60bdda9f5280c694a198f2bd2c1d1d40336" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.601s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Successfully created port: cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 --force-share --output=json" returned: 0 in 0.310s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "e129d60bdda9f5280c694a198f2bd2c1d1d40336" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "e129d60bdda9f5280c694a198f2bd2c1d1d40336" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.063s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 --force-share --output=json" returned: 0 in 0.357s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336,backing_fmt=raw /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336,backing_fmt=raw /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk 1073741824" returned: 0 in 0.097s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "e129d60bdda9f5280c694a198f2bd2c1d1d40336" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.461s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.policy [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6a380973f1c4684b1dca8d8ec8de410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b1386d00864d748f658ae72455d6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 --force-share --output=json" returned: 0 in 0.322s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Creating image(s)
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-2a022fae-2d0d-4da5-afbc-43c3f343bce3 req-b1343aa1-79a6-4a00-a3ba-96da58d14eab service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2a022fae-2d0d-4da5-afbc-43c3f343bce3 req-b1343aa1-79a6-4a00-a3ba-96da58d14eab service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2a022fae-2d0d-4da5-afbc-43c3f343bce3 req-b1343aa1-79a6-4a00-a3ba-96da58d14eab service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2a022fae-2d0d-4da5-afbc-43c3f343bce3 req-b1343aa1-79a6-4a00-a3ba-96da58d14eab service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-2a022fae-2d0d-4da5-afbc-43c3f343bce3 req-b1343aa1-79a6-4a00-a3ba-96da58d14eab service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:38 user nova-compute[74261]: WARNING nova.compute.manager [req-2a022fae-2d0d-4da5-afbc-43c3f343bce3 req-b1343aa1-79a6-4a00-a3ba-96da58d14eab service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state active and task_state None.
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Successfully updated port: cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquired lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-changed-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Refreshing instance network info cache due to event network-changed-cfa28e8b-9db3-4a3f-9e38-535542e7b371. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] Acquiring lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Cannot resize image /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Ensure instance console log exists: /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.251s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.205s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-ec11a523-e466-4bdb-9760-b9ad359283da req-d06771e7-1cf6-4d64-b1e8-cb65bfb76769 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ec11a523-e466-4bdb-9760-b9ad359283da req-d06771e7-1cf6-4d64-b1e8-cb65bfb76769 service nova] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ec11a523-e466-4bdb-9760-b9ad359283da req-d06771e7-1cf6-4d64-b1e8-cb65bfb76769 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ec11a523-e466-4bdb-9760-b9ad359283da req-d06771e7-1cf6-4d64-b1e8-cb65bfb76769 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-ec11a523-e466-4bdb-9760-b9ad359283da req-d06771e7-1cf6-4d64-b1e8-cb65bfb76769 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] No waiting events found dispatching network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:39 user nova-compute[74261]: WARNING nova.compute.manager [req-ec11a523-e466-4bdb-9760-b9ad359283da req-d06771e7-1cf6-4d64-b1e8-cb65bfb76769 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received unexpected event network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d for instance with vm_state active and task_state None.
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk 1073741824" returned: 0 in 0.074s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.249s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updating instance_info_cache with network_info: [{"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Releasing lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Instance network_info: |[{"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] Acquired lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Refreshing network info cache for port cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Start _get_guest_xml network_info=[{"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:44:22Z,direct_url=<?>,disk_format='qcow2',id=54c348de-259f-4849-bcc3-a946848dbbd3,min_disk=0,min_ram=0,name='',owner='37370c8683bd4d3da27889191805ad2d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:44:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_name': '/dev/sda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '54c348de-259f-4849-bcc3-a946848dbbd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:39 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:39 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:44:22Z,direct_url=<?>,disk_format='qcow2',id=54c348de-259f-4849-bcc3-a946848dbbd3,min_disk=0,min_ram=0,name='',owner='37370c8683bd4d3da27889191805ad2d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:44:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1201298073',display_name='tempest-AttachSCSIVolumeTestJSON-server-1201298073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1201298073',id=8,image_ref='54c348de-259f-4849-bcc3-a946848dbbd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5k7FTq6MvyWlSiwgjfEIo4msCmzxwJ697ehjXFZwrmF5mOg3CV5rhe9Qr8NabPn/YE3l0ZoMGPeg1Q6/HorluRKQuhMxKPru3xeXnTJUfuQ2WHXTgf42skZViGl3tuCg==',key_name='tempest-keypair-1942216204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d91912c7347042c99d8b8d31e5cc62cc',ramdisk_id='',reservation_id='r-nrlagpjh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54c348de-259f-4849-bcc3-a946848dbbd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-208244615',owner_user_name='tempest-AttachSCSIVolumeTestJSON-208244615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67aab23b500d41b89051dce4887d9137',uuid=30bf8e80-b31c-44b5-b98e-d754cb3eff8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Converting VIF {"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.objects.instance [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lazy-loading 'pci_devices' on Instance uuid 30bf8e80-b31c-44b5-b98e-d754cb3eff8b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:39 user nova-compute[74261]:   <uuid>30bf8e80-b31c-44b5-b98e-d754cb3eff8b</uuid>
Oct 17 11:44:39 user nova-compute[74261]:   <name>instance-00000008</name>
Oct 17 11:44:39 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:39 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:39 user nova-compute[74261]:   <metadata>
Oct 17 11:44:39 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:39 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:39 user nova-compute[74261]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1201298073</nova:name>
Oct 17 11:44:39 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:39</nova:creationTime>
Oct 17 11:44:39 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:39 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:39 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:39 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:user uuid="67aab23b500d41b89051dce4887d9137">tempest-AttachSCSIVolumeTestJSON-208244615-project-member</nova:user>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:project uuid="d91912c7347042c99d8b8d31e5cc62cc">tempest-AttachSCSIVolumeTestJSON-208244615</nova:project>
Oct 17 11:44:39 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:39 user nova-compute[74261]:       <nova:root type="image" uuid="54c348de-259f-4849-bcc3-a946848dbbd3"/>
Oct 17 11:44:39 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:39 user nova-compute[74261]:         <nova:port uuid="cfa28e8b-9db3-4a3f-9e38-535542e7b371">
Oct 17 11:44:39 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 11:44:39 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:39 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:39 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:39 user nova-compute[74261]:   </metadata>
Oct 17 11:44:39 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:39 user nova-compute[74261]:     <system>
Oct 17 11:44:39 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:39 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:39 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:39 user nova-compute[74261]:       <entry name="serial">30bf8e80-b31c-44b5-b98e-d754cb3eff8b</entry>
Oct 17 11:44:39 user nova-compute[74261]:       <entry name="uuid">30bf8e80-b31c-44b5-b98e-d754cb3eff8b</entry>
Oct 17 11:44:39 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:39 user nova-compute[74261]:     </system>
Oct 17 11:44:39 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:39 user nova-compute[74261]:   <os>
Oct 17 11:44:39 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:39 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:39 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:39 user nova-compute[74261]:   </os>
Oct 17 11:44:39 user nova-compute[74261]:   <features>
Oct 17 11:44:39 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:39 user nova-compute[74261]:     <apic/>
Oct 17 11:44:39 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:39 user nova-compute[74261]:   </features>
Oct 17 11:44:39 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:39 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:39 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:39 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:39 user nova-compute[74261]:   </clock>
Oct 17 11:44:39 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:39 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:39 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:39 user nova-compute[74261]:   </cpu>
Oct 17 11:44:39 user nova-compute[74261]:   <devices>
Oct 17 11:44:39 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:39 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:39 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk"/>
Oct 17 11:44:39 user nova-compute[74261]:       <target dev="sda" bus="scsi"/>
Oct 17 11:44:39 user nova-compute[74261]:       <address type="drive" controller="0" unit="0"/>
Oct 17 11:44:39 user nova-compute[74261]:     </disk>
Oct 17 11:44:39 user nova-compute[74261]:     <disk type="file" device="cdrom">
Oct 17 11:44:39 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 11:44:39 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.config"/>
Oct 17 11:44:39 user nova-compute[74261]:       <target dev="sdb" bus="scsi"/>
Oct 17 11:44:39 user nova-compute[74261]:       <address type="drive" controller="0" unit="1"/>
Oct 17 11:44:39 user nova-compute[74261]:     </disk>
Oct 17 11:44:39 user nova-compute[74261]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 17 11:44:39 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:39 user nova-compute[74261]:       <mac address="fa:16:3e:d6:c7:e9"/>
Oct 17 11:44:39 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:39 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:39 user nova-compute[74261]:       <target dev="tapcfa28e8b-9d"/>
Oct 17 11:44:39 user nova-compute[74261]:     </interface>
Oct 17 11:44:39 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:39 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/console.log" append="off"/>
Oct 17 11:44:39 user nova-compute[74261]:     </serial>
Oct 17 11:44:39 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:39 user nova-compute[74261]:     <video>
Oct 17 11:44:39 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:39 user nova-compute[74261]:     </video>
Oct 17 11:44:39 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:39 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:39 user nova-compute[74261]:     </rng>
Oct 17 11:44:39 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:39 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:39 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:39 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:39 user nova-compute[74261]:   </devices>
Oct 17 11:44:39 user nova-compute[74261]: </domain>
Oct 17 11:44:39 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1201298073',display_name='tempest-AttachSCSIVolumeTestJSON-server-1201298073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1201298073',id=8,image_ref='54c348de-259f-4849-bcc3-a946848dbbd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5k7FTq6MvyWlSiwgjfEIo4msCmzxwJ697ehjXFZwrmF5mOg3CV5rhe9Qr8NabPn/YE3l0ZoMGPeg1Q6/HorluRKQuhMxKPru3xeXnTJUfuQ2WHXTgf42skZViGl3tuCg==',key_name='tempest-keypair-1942216204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d91912c7347042c99d8b8d31e5cc62cc',ramdisk_id='',reservation_id='r-nrlagpjh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54c348de-259f-4849-bcc3-a946848dbbd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-208244615',owner_user_name='tempest-AttachSCSIVolumeTestJSON-208244615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67aab23b500d41b89051dce4887d9137',uuid=30bf8e80-b31c-44b5-b98e-d754cb3eff8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Converting VIF {"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG os_vif [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8311e978-f624-5eb2-a3e9-e700bd1e9df5', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.377s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Cannot resize image /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Ensure instance console log exists: /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfa28e8b-9d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfa28e8b-9d, col_values=(('qos', UUID('f0a8074f-184d-4ae3-a67c-2ea834017155')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfa28e8b-9d, col_values=(('external_ids', {'iface-id': 'cfa28e8b-9db3-4a3f-9e38-535542e7b371', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:c7:e9', 'vm-uuid': '30bf8e80-b31c-44b5-b98e-d754cb3eff8b'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: INFO os_vif [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d')
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No BDM found with device name sda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No VIF found with MAC fa:16:3e:d6:c7:e9, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Using config drive
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Creating config drive at /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.config
Oct 17 11:44:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0iu7v0yj {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0iu7v0yj" returned: 0 in 0.090s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Successfully created port: c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.network.neutron [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updated VIF entry in instance network info cache for port cfa28e8b-9db3-4a3f-9e38-535542e7b371. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.network.neutron [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updating instance_info_cache with network_info: [{"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cf30e86c-0fee-44f2-bed4-dfc424ed19d9 req-db089ea1-6a41-4d16-9a0e-4c49bdbc8061 service nova] Releasing lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-46a9ac71-1c46-43ef-b56f-e9b8ec58a2be req-60d642ce-8f5e-456f-b63b-aff49ac99934 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46a9ac71-1c46-43ef-b56f-e9b8ec58a2be req-60d642ce-8f5e-456f-b63b-aff49ac99934 service nova] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46a9ac71-1c46-43ef-b56f-e9b8ec58a2be req-60d642ce-8f5e-456f-b63b-aff49ac99934 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46a9ac71-1c46-43ef-b56f-e9b8ec58a2be req-60d642ce-8f5e-456f-b63b-aff49ac99934 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-46a9ac71-1c46-43ef-b56f-e9b8ec58a2be req-60d642ce-8f5e-456f-b63b-aff49ac99934 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] No waiting events found dispatching network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:41 user nova-compute[74261]: WARNING nova.compute.manager [req-46a9ac71-1c46-43ef-b56f-e9b8ec58a2be req-60d642ce-8f5e-456f-b63b-aff49ac99934 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received unexpected event network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d for instance with vm_state active and task_state None.
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:41 user nova-compute[74261]: INFO nova.compute.claims [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Claim successful on node user
Oct 17 11:44:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Successfully updated port: c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquired lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.031s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-dcc47e0c-3b06-4b62-9e7e-29dcd02f7dbf req-c5bba7d6-bc59-4df4-8328-6ff1cbc51ad5 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dcc47e0c-3b06-4b62-9e7e-29dcd02f7dbf req-c5bba7d6-bc59-4df4-8328-6ff1cbc51ad5 service nova] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dcc47e0c-3b06-4b62-9e7e-29dcd02f7dbf req-c5bba7d6-bc59-4df4-8328-6ff1cbc51ad5 service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dcc47e0c-3b06-4b62-9e7e-29dcd02f7dbf req-c5bba7d6-bc59-4df4-8328-6ff1cbc51ad5 service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-dcc47e0c-3b06-4b62-9e7e-29dcd02f7dbf req-c5bba7d6-bc59-4df4-8328-6ff1cbc51ad5 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] No waiting events found dispatching network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:42 user nova-compute[74261]: WARNING nova.compute.manager [req-dcc47e0c-3b06-4b62-9e7e-29dcd02f7dbf req-c5bba7d6-bc59-4df4-8328-6ff1cbc51ad5 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received unexpected event network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 for instance with vm_state building and task_state spawning.
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:43 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.policy [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '717ab8583e0e4d66b9e834c0299ea775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5522812b0714ec4896a140ad12be9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:43 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Creating image(s)
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "/opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "/opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Releasing lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Instance network_info: |[{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Start _get_guest_xml network_info=[{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-changed-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Refreshing instance network info cache due to event network-changed-c52b809b-bc53-45bf-b53d-58b724efacf7. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] Acquiring lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] Acquired lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Refreshing network info cache for port c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'pci_devices' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:43 user nova-compute[74261]:   <uuid>bfccfe8a-4414-44b0-9e94-12b6f7003406</uuid>
Oct 17 11:44:43 user nova-compute[74261]:   <name>instance-00000009</name>
Oct 17 11:44:43 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:43 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:43 user nova-compute[74261]:   <metadata>
Oct 17 11:44:43 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:43 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:43 user nova-compute[74261]:       <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:44:43 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:43</nova:creationTime>
Oct 17 11:44:43 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:43 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:43 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:43 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:44:43 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:43 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:43 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:43 user nova-compute[74261]:         <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:44:43 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:44:43 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:43 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:43 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:43 user nova-compute[74261]:   </metadata>
Oct 17 11:44:43 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:43 user nova-compute[74261]:     <system>
Oct 17 11:44:43 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:43 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:43 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:43 user nova-compute[74261]:       <entry name="serial">bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:44:43 user nova-compute[74261]:       <entry name="uuid">bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:44:43 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:43 user nova-compute[74261]:     </system>
Oct 17 11:44:43 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:43 user nova-compute[74261]:   <os>
Oct 17 11:44:43 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:43 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:43 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:43 user nova-compute[74261]:   </os>
Oct 17 11:44:43 user nova-compute[74261]:   <features>
Oct 17 11:44:43 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:43 user nova-compute[74261]:     <apic/>
Oct 17 11:44:43 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:43 user nova-compute[74261]:   </features>
Oct 17 11:44:43 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:43 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:43 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:43 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:43 user nova-compute[74261]:   </clock>
Oct 17 11:44:43 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:43 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:43 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:43 user nova-compute[74261]:   </cpu>
Oct 17 11:44:43 user nova-compute[74261]:   <devices>
Oct 17 11:44:43 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:43 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:43 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk"/>
Oct 17 11:44:43 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:43 user nova-compute[74261]:     </disk>
Oct 17 11:44:43 user nova-compute[74261]:     <disk type="file" device="cdrom">
Oct 17 11:44:43 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 11:44:43 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config"/>
Oct 17 11:44:43 user nova-compute[74261]:       <target dev="hda" bus="ide"/>
Oct 17 11:44:43 user nova-compute[74261]:     </disk>
Oct 17 11:44:43 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:43 user nova-compute[74261]:       <mac address="fa:16:3e:44:d7:13"/>
Oct 17 11:44:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:43 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:43 user nova-compute[74261]:       <target dev="tapc52b809b-bc"/>
Oct 17 11:44:43 user nova-compute[74261]:     </interface>
Oct 17 11:44:43 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:43 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log" append="off"/>
Oct 17 11:44:43 user nova-compute[74261]:     </serial>
Oct 17 11:44:43 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:43 user nova-compute[74261]:     <video>
Oct 17 11:44:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:43 user nova-compute[74261]:     </video>
Oct 17 11:44:43 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:43 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:43 user nova-compute[74261]:     </rng>
Oct 17 11:44:43 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:43 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:43 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:43 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:43 user nova-compute[74261]:   </devices>
Oct 17 11:44:43 user nova-compute[74261]: </domain>
Oct 17 11:44:43 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG os_vif [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b76d0e4-f80d-53ca-9e9a-508bb96cd923', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc52b809b-bc, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc52b809b-bc, col_values=(('qos', UUID('b565976e-55fe-4dfc-a3cf-48f17c3a8b5e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc52b809b-bc, col_values=(('external_ids', {'iface-id': 'c52b809b-bc53-45bf-b53d-58b724efacf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d7:13', 'vm-uuid': 'bfccfe8a-4414-44b0-9e94-12b6f7003406'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.353s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:43 user nova-compute[74261]: INFO os_vif [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc')
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No BDM found with device name hda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No VIF found with MAC fa:16:3e:44:d7:13, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:44 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Using config drive
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.255s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Successfully created port: 1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk 1073741824" returned: 0 in 0.070s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:44:44 user nova-compute[74261]: INFO nova.compute.claims [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Claim successful on node user
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:44 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Creating config drive at /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz98a7cbn {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz98a7cbn" returned: 0 in 0.082s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Cannot resize image /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Ensure instance console log exists: /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updated VIF entry in instance network info cache for port c52b809b-bc53-45bf-b53d-58b724efacf7. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c03bfa5a-28de-4468-b3c7-425d7dd7763c req-1a3831e1-276d-4a66-865e-f7625e7e5b18 service nova] Releasing lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Successfully updated port: 1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquired lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-changed-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Refreshing instance network info cache due to event network-changed-1774a9a4-4e0b-473a-9c1d-cc03100e96b4. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] Acquiring lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-2e0a746f-7e33-431e-80c1-2d5f84012599 req-c52057b6-566d-4589-9b66-d827677c2d3c service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2e0a746f-7e33-431e-80c1-2d5f84012599 req-c52057b6-566d-4589-9b66-d827677c2d3c service nova] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2e0a746f-7e33-431e-80c1-2d5f84012599 req-c52057b6-566d-4589-9b66-d827677c2d3c service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2e0a746f-7e33-431e-80c1-2d5f84012599 req-c52057b6-566d-4589-9b66-d827677c2d3c service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-2e0a746f-7e33-431e-80c1-2d5f84012599 req-c52057b6-566d-4589-9b66-d827677c2d3c service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] No waiting events found dispatching network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:45 user nova-compute[74261]: WARNING nova.compute.manager [req-2e0a746f-7e33-431e-80c1-2d5f84012599 req-c52057b6-566d-4589-9b66-d827677c2d3c service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received unexpected event network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 for instance with vm_state building and task_state spawning.
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:44:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updating instance_info_cache with network_info: [{"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Releasing lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Instance network_info: |[{"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] Acquired lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Refreshing network info cache for port 1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Start _get_guest_xml network_info=[{"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.policy [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a6ba3cb987b4c2795e52e4184fd1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a2faca67694807aaf9afae93249fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:45 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1570921175',display_name='tempest-TestVolumeSwap-server-1570921175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1570921175',id=10,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+L4cAY2XKAQyuODf1b88yuRhiKFwfXRqRE/bG3QpQqU8+pZsybpy/unbzBpwr0wHJLSiRhX0S9ObEQc+hkKTQEfXD+lZ7X8TH4aRQ54XaOf6kO1kR0nX4izggoUvl3+g==',key_name='tempest-keypair-608785386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5522812b0714ec4896a140ad12be9d2',ramdisk_id='',reservation_id='r-1rvqmtni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2127134927',owner_user_name='tempest-TestVolumeSwap-2127134927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='717ab8583e0e4d66b9e834c0299ea775',uuid=d0bc8ec6-6f50-4013-a360-71c64069ed2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Converting VIF {"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.objects.instance [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lazy-loading 'pci_devices' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:44:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Creating image(s)
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "/opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "/opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:45 user nova-compute[74261]:   <uuid>d0bc8ec6-6f50-4013-a360-71c64069ed2f</uuid>
Oct 17 11:44:45 user nova-compute[74261]:   <name>instance-0000000a</name>
Oct 17 11:44:45 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:45 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:45 user nova-compute[74261]:   <metadata>
Oct 17 11:44:45 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:45 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:45 user nova-compute[74261]:       <nova:name>tempest-TestVolumeSwap-server-1570921175</nova:name>
Oct 17 11:44:45 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:45</nova:creationTime>
Oct 17 11:44:45 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:45 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:45 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:45 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:user uuid="717ab8583e0e4d66b9e834c0299ea775">tempest-TestVolumeSwap-2127134927-project-member</nova:user>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:project uuid="a5522812b0714ec4896a140ad12be9d2">tempest-TestVolumeSwap-2127134927</nova:project>
Oct 17 11:44:45 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:45 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:45 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:45 user nova-compute[74261]:         <nova:port uuid="1774a9a4-4e0b-473a-9c1d-cc03100e96b4">
Oct 17 11:44:45 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 11:44:45 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:45 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:45 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:45 user nova-compute[74261]:   </metadata>
Oct 17 11:44:45 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:45 user nova-compute[74261]:     <system>
Oct 17 11:44:45 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:45 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:45 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:45 user nova-compute[74261]:       <entry name="serial">d0bc8ec6-6f50-4013-a360-71c64069ed2f</entry>
Oct 17 11:44:45 user nova-compute[74261]:       <entry name="uuid">d0bc8ec6-6f50-4013-a360-71c64069ed2f</entry>
Oct 17 11:44:45 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:45 user nova-compute[74261]:     </system>
Oct 17 11:44:45 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:45 user nova-compute[74261]:   <os>
Oct 17 11:44:45 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:45 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:45 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:45 user nova-compute[74261]:   </os>
Oct 17 11:44:45 user nova-compute[74261]:   <features>
Oct 17 11:44:45 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:45 user nova-compute[74261]:     <apic/>
Oct 17 11:44:45 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:45 user nova-compute[74261]:   </features>
Oct 17 11:44:45 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:45 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:45 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:45 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:45 user nova-compute[74261]:   </clock>
Oct 17 11:44:45 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:45 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:45 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:45 user nova-compute[74261]:   </cpu>
Oct 17 11:44:45 user nova-compute[74261]:   <devices>
Oct 17 11:44:45 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:45 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:45 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk"/>
Oct 17 11:44:45 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:45 user nova-compute[74261]:     </disk>
Oct 17 11:44:45 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:45 user nova-compute[74261]:       <mac address="fa:16:3e:f6:69:19"/>
Oct 17 11:44:45 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:45 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:45 user nova-compute[74261]:       <target dev="tap1774a9a4-4e"/>
Oct 17 11:44:45 user nova-compute[74261]:     </interface>
Oct 17 11:44:45 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:45 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/console.log" append="off"/>
Oct 17 11:44:45 user nova-compute[74261]:     </serial>
Oct 17 11:44:45 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:45 user nova-compute[74261]:     <video>
Oct 17 11:44:45 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:45 user nova-compute[74261]:     </video>
Oct 17 11:44:45 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:45 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:45 user nova-compute[74261]:     </rng>
Oct 17 11:44:45 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:45 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:45 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:45 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:45 user nova-compute[74261]:   </devices>
Oct 17 11:44:45 user nova-compute[74261]: </domain>
Oct 17 11:44:45 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1570921175',display_name='tempest-TestVolumeSwap-server-1570921175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1570921175',id=10,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+L4cAY2XKAQyuODf1b88yuRhiKFwfXRqRE/bG3QpQqU8+pZsybpy/unbzBpwr0wHJLSiRhX0S9ObEQc+hkKTQEfXD+lZ7X8TH4aRQ54XaOf6kO1kR0nX4izggoUvl3+g==',key_name='tempest-keypair-608785386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5522812b0714ec4896a140ad12be9d2',ramdisk_id='',reservation_id='r-1rvqmtni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2127134927',owner_user_name='tempest-TestVolumeSwap-2127134927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='717ab8583e0e4d66b9e834c0299ea775',uuid=d0bc8ec6-6f50-4013-a360-71c64069ed2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Converting VIF {"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG os_vif [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9a3549f-81a6-5caa-a54c-4ab57b61ed22', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Instance spawned successfully.
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1774a9a4-4e, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1774a9a4-4e, col_values=(('qos', UUID('b75d7abd-68c2-4ff6-b7e2-21ae2a958f3e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1774a9a4-4e, col_values=(('external_ids', {'iface-id': '1774a9a4-4e0b-473a-9c1d-cc03100e96b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:69:19', 'vm-uuid': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:45 user nova-compute[74261]: INFO os_vif [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e')
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] No VIF found with MAC fa:16:3e:f6:69:19, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:45 user nova-compute[74261]: INFO nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Took 9.63 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:45 user nova-compute[74261]: INFO nova.compute.manager [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Took 11.39 seconds to build instance.
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bb0cfc7d-6e42-4188-853c-723ffced27d8 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.582s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updated VIF entry in instance network info cache for port 1774a9a4-4e0b-473a-9c1d-cc03100e96b4. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updating instance_info_cache with network_info: [{"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02be4345-3d43-4f09-b999-022c0e0727a3 req-4ebc2844-35c6-4b4d-a02e-96d3374581d3 service nova] Releasing lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk 1073741824" returned: 0 in 0.067s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Successfully created port: b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.254s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Cannot resize image /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Ensure instance console log exists: /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Successfully updated port: b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquired lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-changed-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Refreshing instance network info cache due to event network-changed-b0662753-f337-4936-ac4f-6dd0f83f7bfb. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] Acquiring lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updating instance_info_cache with network_info: [{"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Releasing lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Instance network_info: |[{"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] Acquired lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.network.neutron [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Refreshing network info cache for port b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Start _get_guest_xml network_info=[{"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:44:47 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:47 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1698857625',display_name='tempest-VolumesAssistedSnapshotsTest-server-1698857625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1698857625',id=11,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBmHblHkcfqGj/kxwuSM4xuabPqkyXfnyU/KHs9A1nTAj15P/NxLio9TIIXbZjr7GDv8u1EBMaLK9TbGf1CZkHnB6w5oeDVAIHQF6S5VbVqBMs+bA74JC+dYKtwKM20Fg==',key_name='tempest-keypair-1531965803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81a2faca67694807aaf9afae93249fe1',ramdisk_id='',reservation_id='r-b5ie824j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-181164323',owner_user_name='tempest-VolumesAssistedSnapshotsTest-181164323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a6ba3cb987b4c2795e52e4184fd1e5e',uuid=ea0ea436-4137-4c76-b12b-9d68f8646825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Converting VIF {"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lazy-loading 'pci_devices' on Instance uuid ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:44:47 user nova-compute[74261]:   <uuid>ea0ea436-4137-4c76-b12b-9d68f8646825</uuid>
Oct 17 11:44:47 user nova-compute[74261]:   <name>instance-0000000b</name>
Oct 17 11:44:47 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:44:47 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:44:47 user nova-compute[74261]:   <metadata>
Oct 17 11:44:47 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:44:47 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:44:47 user nova-compute[74261]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1698857625</nova:name>
Oct 17 11:44:47 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:44:47</nova:creationTime>
Oct 17 11:44:47 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:44:47 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:44:47 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:44:47 user nova-compute[74261]:       <nova:owner>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:user uuid="9a6ba3cb987b4c2795e52e4184fd1e5e">tempest-VolumesAssistedSnapshotsTest-181164323-project-member</nova:user>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:project uuid="81a2faca67694807aaf9afae93249fe1">tempest-VolumesAssistedSnapshotsTest-181164323</nova:project>
Oct 17 11:44:47 user nova-compute[74261]:       </nova:owner>
Oct 17 11:44:47 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:44:47 user nova-compute[74261]:       <nova:ports>
Oct 17 11:44:47 user nova-compute[74261]:         <nova:port uuid="b0662753-f337-4936-ac4f-6dd0f83f7bfb">
Oct 17 11:44:47 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:44:47 user nova-compute[74261]:         </nova:port>
Oct 17 11:44:47 user nova-compute[74261]:       </nova:ports>
Oct 17 11:44:47 user nova-compute[74261]:     </nova:instance>
Oct 17 11:44:47 user nova-compute[74261]:   </metadata>
Oct 17 11:44:47 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:44:47 user nova-compute[74261]:     <system>
Oct 17 11:44:47 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:44:47 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:44:47 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:44:47 user nova-compute[74261]:       <entry name="serial">ea0ea436-4137-4c76-b12b-9d68f8646825</entry>
Oct 17 11:44:47 user nova-compute[74261]:       <entry name="uuid">ea0ea436-4137-4c76-b12b-9d68f8646825</entry>
Oct 17 11:44:47 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:44:47 user nova-compute[74261]:     </system>
Oct 17 11:44:47 user nova-compute[74261]:   </sysinfo>
Oct 17 11:44:47 user nova-compute[74261]:   <os>
Oct 17 11:44:47 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:44:47 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:44:47 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:44:47 user nova-compute[74261]:   </os>
Oct 17 11:44:47 user nova-compute[74261]:   <features>
Oct 17 11:44:47 user nova-compute[74261]:     <acpi/>
Oct 17 11:44:47 user nova-compute[74261]:     <apic/>
Oct 17 11:44:47 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:44:47 user nova-compute[74261]:   </features>
Oct 17 11:44:47 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:44:47 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:44:47 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:44:47 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:44:47 user nova-compute[74261]:   </clock>
Oct 17 11:44:47 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:44:47 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:44:47 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:44:47 user nova-compute[74261]:   </cpu>
Oct 17 11:44:47 user nova-compute[74261]:   <devices>
Oct 17 11:44:47 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:44:47 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:44:47 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk"/>
Oct 17 11:44:47 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:44:47 user nova-compute[74261]:     </disk>
Oct 17 11:44:47 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:44:47 user nova-compute[74261]:       <mac address="fa:16:3e:44:66:b0"/>
Oct 17 11:44:47 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:47 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:44:47 user nova-compute[74261]:       <target dev="tapb0662753-f3"/>
Oct 17 11:44:47 user nova-compute[74261]:     </interface>
Oct 17 11:44:47 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:44:47 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/console.log" append="off"/>
Oct 17 11:44:47 user nova-compute[74261]:     </serial>
Oct 17 11:44:47 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:44:47 user nova-compute[74261]:     <video>
Oct 17 11:44:47 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:44:47 user nova-compute[74261]:     </video>
Oct 17 11:44:47 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:44:47 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:44:47 user nova-compute[74261]:     </rng>
Oct 17 11:44:47 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:44:47 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:44:47 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:44:47 user nova-compute[74261]:     </memballoon>
Oct 17 11:44:47 user nova-compute[74261]:   </devices>
Oct 17 11:44:47 user nova-compute[74261]: </domain>
Oct 17 11:44:47 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1698857625',display_name='tempest-VolumesAssistedSnapshotsTest-server-1698857625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1698857625',id=11,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBmHblHkcfqGj/kxwuSM4xuabPqkyXfnyU/KHs9A1nTAj15P/NxLio9TIIXbZjr7GDv8u1EBMaLK9TbGf1CZkHnB6w5oeDVAIHQF6S5VbVqBMs+bA74JC+dYKtwKM20Fg==',key_name='tempest-keypair-1531965803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81a2faca67694807aaf9afae93249fe1',ramdisk_id='',reservation_id='r-b5ie824j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-181164323',owner_user_name='tempest-VolumesAssistedSnapshotsTest-181164323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a6ba3cb987b4c2795e52e4184fd1e5e',uuid=ea0ea436-4137-4c76-b12b-9d68f8646825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Converting VIF {"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG os_vif [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af1c24e1-ec34-5b7b-a582-b17ef9a7b521', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0662753-f3, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0662753-f3, col_values=(('qos', UUID('753bb464-9a3f-475c-8de5-37e9035849a6')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0662753-f3, col_values=(('external_ids', {'iface-id': 'b0662753-f337-4936-ac4f-6dd0f83f7bfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:66:b0', 'vm-uuid': 'ea0ea436-4137-4c76-b12b-9d68f8646825'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: INFO os_vif [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3')
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] No VIF found with MAC fa:16:3e:44:66:b0, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.network.neutron [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updated VIF entry in instance network info cache for port b0662753-f337-4936-ac4f-6dd0f83f7bfb. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.network.neutron [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updating instance_info_cache with network_info: [{"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17d7fe60-1db5-4f62-a00e-415027486a01 req-79418877-baa7-49ef-b409-2d5467033d17 service nova] Releasing lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] No waiting events found dispatching network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:48 user nova-compute[74261]: WARNING nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received unexpected event network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 for instance with vm_state active and task_state None.
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] No waiting events found dispatching network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:48 user nova-compute[74261]: WARNING nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received unexpected event network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 for instance with vm_state active and task_state None.
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] No waiting events found dispatching network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:48 user nova-compute[74261]: WARNING nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received unexpected event network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 for instance with vm_state active and task_state None.
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] No waiting events found dispatching network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:48 user nova-compute[74261]: WARNING nova.compute.manager [req-6837063f-7eca-45a7-9392-0e08be57fe08 req-f83ea147-6e35-4967-90d5-c6588176efc0 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received unexpected event network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 for instance with vm_state active and task_state None.
Oct 17 11:44:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-54fb7503-82ca-4828-aa77-baf72b92902d req-f11e9ae2-84f4-407e-8f09-88c0c5bf0207 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-54fb7503-82ca-4828-aa77-baf72b92902d req-f11e9ae2-84f4-407e-8f09-88c0c5bf0207 service nova] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-54fb7503-82ca-4828-aa77-baf72b92902d req-f11e9ae2-84f4-407e-8f09-88c0c5bf0207 service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-54fb7503-82ca-4828-aa77-baf72b92902d req-f11e9ae2-84f4-407e-8f09-88c0c5bf0207 service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-54fb7503-82ca-4828-aa77-baf72b92902d req-f11e9ae2-84f4-407e-8f09-88c0c5bf0207 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] No waiting events found dispatching network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:49 user nova-compute[74261]: WARNING nova.compute.manager [req-54fb7503-82ca-4828-aa77-baf72b92902d req-f11e9ae2-84f4-407e-8f09-88c0c5bf0207 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received unexpected event network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb for instance with vm_state building and task_state spawning.
Oct 17 11:44:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:50 user nova-compute[74261]: WARNING nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 for instance with vm_state building and task_state spawning.
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:50 user nova-compute[74261]: WARNING nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 for instance with vm_state building and task_state spawning.
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] No waiting events found dispatching network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:50 user nova-compute[74261]: WARNING nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received unexpected event network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 for instance with vm_state building and task_state spawning.
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] No waiting events found dispatching network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:50 user nova-compute[74261]: WARNING nova.compute.manager [req-ab7db631-4b77-4a46-8af7-66a2092585e4 req-a5f1daf4-566d-43c7-b5c9-1d73768c8924 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received unexpected event network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 for instance with vm_state building and task_state spawning.
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:51 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Instance spawned successfully.
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:51 user nova-compute[74261]: INFO nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Took 12.50 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:51 user nova-compute[74261]: INFO nova.compute.manager [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Took 14.39 seconds to build instance.
Oct 17 11:44:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3c2dc29a-f5b2-4b40-8043-853cec3011c1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.593s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-e12dd6d5-a71c-4a02-9fa3-4d489becb42c req-0f28d041-172d-4001-8033-d97c09c80335 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e12dd6d5-a71c-4a02-9fa3-4d489becb42c req-0f28d041-172d-4001-8033-d97c09c80335 service nova] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e12dd6d5-a71c-4a02-9fa3-4d489becb42c req-0f28d041-172d-4001-8033-d97c09c80335 service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e12dd6d5-a71c-4a02-9fa3-4d489becb42c req-0f28d041-172d-4001-8033-d97c09c80335 service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-e12dd6d5-a71c-4a02-9fa3-4d489becb42c req-0f28d041-172d-4001-8033-d97c09c80335 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] No waiting events found dispatching network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:44:51 user nova-compute[74261]: WARNING nova.compute.manager [req-e12dd6d5-a71c-4a02-9fa3-4d489becb42c req-0f28d041-172d-4001-8033-d97c09c80335 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received unexpected event network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb for instance with vm_state building and task_state spawning.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Instance spawned successfully.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:44:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Instance spawned successfully.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:52 user nova-compute[74261]: INFO nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Took 6.94 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:52 user nova-compute[74261]: INFO nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Took 8.95 seconds to spawn the instance on the hypervisor.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:44:52 user nova-compute[74261]: INFO nova.compute.manager [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Took 8.30 seconds to build instance.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 11:44:52 user nova-compute[74261]: INFO nova.compute.manager [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Took 10.78 seconds to build instance.
Oct 17 11:44:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-80b3329c-1b72-49be-bf8f-6e7092bf9457 tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.546s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ab4bbba-8020-485f-a4f1-369b9665626b tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.954s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:44:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid f92dc0ae-f230-43b3-8020-1e22ccb1d491 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:44:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updating instance_info_cache with network_info: [{"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:44:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f92dc0ae-f230-43b3-8020-1e22ccb1d491" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:44:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:44:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:01 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:45:01 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7309MB free_disk=25.698158264160156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f92dc0ae-f230-43b3-8020-1e22ccb1d491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance bfccfe8a-4414-44b0-9e94-12b6f7003406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d0bc8ec6-6f50-4013-a360-71c64069ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance ea0ea436-4137-4c76-b12b-9d68f8646825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 11:45:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 11:45:02 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:45:02 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:45:02 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:45:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.906s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:45:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:45:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:45:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 11:45:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:45:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:45:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:45:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 11:45:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:45:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:45:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:45:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 11:45:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:45:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:45:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:45:55 user nova-compute[74261]: INFO nova.compute.claims [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Claim successful on node user
Oct 17 11:45:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-changed-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Refreshing instance network info cache due to event network-changed-201cf343-4cde-41f1-b5c3-166f7583eb1d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:45:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Refreshing network info cache for port 201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:45:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updated VIF entry in instance network info cache for port 201cf343-4cde-41f1-b5c3-166f7583eb1d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-18347350-557f-4f57-a073-470a037c286b req-dcc3455e-137b-4af9-8225-d0e85ba3649a service nova] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.policy [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57dc5550d0fb4f0f8aaf2633b1ad6095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8bd718919439f8a804d2b74561f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:45:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Creating image(s)
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "/opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "/opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.282s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Successfully created port: a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk 1073741824" returned: 0 in 0.058s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Cannot resize image /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Ensure instance console log exists: /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Successfully updated port: a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "refresh_cache-bdf1a49d-31bc-4d33-90cc-1837754cfcee" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquired lock "refresh_cache-bdf1a49d-31bc-4d33-90cc-1837754cfcee" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-changed-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Refreshing instance network info cache due to event network-changed-a7e5ec38-3701-473a-a517-bc04f0030180. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] Acquiring lock "refresh_cache-bdf1a49d-31bc-4d33-90cc-1837754cfcee" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing instance network info cache due to event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:45:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Updating instance_info_cache with network_info: [{"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Releasing lock "refresh_cache-bdf1a49d-31bc-4d33-90cc-1837754cfcee" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Instance network_info: |[{"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] Acquired lock "refresh_cache-bdf1a49d-31bc-4d33-90cc-1837754cfcee" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.neutron [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Refreshing network info cache for port a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Start _get_guest_xml network_info=[{"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:45:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:45:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-857782247',display_name='tempest-ServersNegativeTestJSON-server-857782247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-857782247',id=12,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8bd718919439f8a804d2b74561f1d',ramdisk_id='',reservation_id='r-q0gifj99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086864809',owner_user_name='tempest-ServersNegativeTestJSON-1086864809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:45:56Z,user_data=None,user_id='57dc5550d0fb4f0f8aaf2633b1ad6095',uuid=bdf1a49d-31bc-4d33-90cc-1837754cfcee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converting VIF {"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lazy-loading 'pci_devices' on Instance uuid bdf1a49d-31bc-4d33-90cc-1837754cfcee {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:45:58 user nova-compute[74261]:   <uuid>bdf1a49d-31bc-4d33-90cc-1837754cfcee</uuid>
Oct 17 11:45:58 user nova-compute[74261]:   <name>instance-0000000c</name>
Oct 17 11:45:58 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:45:58 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:45:58 user nova-compute[74261]:   <metadata>
Oct 17 11:45:58 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:45:58 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:45:58 user nova-compute[74261]:       <nova:name>tempest-ServersNegativeTestJSON-server-857782247</nova:name>
Oct 17 11:45:58 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:45:58</nova:creationTime>
Oct 17 11:45:58 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:45:58 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:45:58 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:45:58 user nova-compute[74261]:       <nova:owner>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:user uuid="57dc5550d0fb4f0f8aaf2633b1ad6095">tempest-ServersNegativeTestJSON-1086864809-project-member</nova:user>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:project uuid="a7c8bd718919439f8a804d2b74561f1d">tempest-ServersNegativeTestJSON-1086864809</nova:project>
Oct 17 11:45:58 user nova-compute[74261]:       </nova:owner>
Oct 17 11:45:58 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:45:58 user nova-compute[74261]:       <nova:ports>
Oct 17 11:45:58 user nova-compute[74261]:         <nova:port uuid="a7e5ec38-3701-473a-a517-bc04f0030180">
Oct 17 11:45:58 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:45:58 user nova-compute[74261]:         </nova:port>
Oct 17 11:45:58 user nova-compute[74261]:       </nova:ports>
Oct 17 11:45:58 user nova-compute[74261]:     </nova:instance>
Oct 17 11:45:58 user nova-compute[74261]:   </metadata>
Oct 17 11:45:58 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:45:58 user nova-compute[74261]:     <system>
Oct 17 11:45:58 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:45:58 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:45:58 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:45:58 user nova-compute[74261]:       <entry name="serial">bdf1a49d-31bc-4d33-90cc-1837754cfcee</entry>
Oct 17 11:45:58 user nova-compute[74261]:       <entry name="uuid">bdf1a49d-31bc-4d33-90cc-1837754cfcee</entry>
Oct 17 11:45:58 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:45:58 user nova-compute[74261]:     </system>
Oct 17 11:45:58 user nova-compute[74261]:   </sysinfo>
Oct 17 11:45:58 user nova-compute[74261]:   <os>
Oct 17 11:45:58 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:45:58 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:45:58 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:45:58 user nova-compute[74261]:   </os>
Oct 17 11:45:58 user nova-compute[74261]:   <features>
Oct 17 11:45:58 user nova-compute[74261]:     <acpi/>
Oct 17 11:45:58 user nova-compute[74261]:     <apic/>
Oct 17 11:45:58 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:45:58 user nova-compute[74261]:   </features>
Oct 17 11:45:58 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:45:58 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:45:58 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:45:58 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:45:58 user nova-compute[74261]:   </clock>
Oct 17 11:45:58 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:45:58 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:45:58 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:45:58 user nova-compute[74261]:   </cpu>
Oct 17 11:45:58 user nova-compute[74261]:   <devices>
Oct 17 11:45:58 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:45:58 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:45:58 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk"/>
Oct 17 11:45:58 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:45:58 user nova-compute[74261]:     </disk>
Oct 17 11:45:58 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:45:58 user nova-compute[74261]:       <mac address="fa:16:3e:89:7d:40"/>
Oct 17 11:45:58 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:45:58 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:45:58 user nova-compute[74261]:       <target dev="tapa7e5ec38-37"/>
Oct 17 11:45:58 user nova-compute[74261]:     </interface>
Oct 17 11:45:58 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:45:58 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/console.log" append="off"/>
Oct 17 11:45:58 user nova-compute[74261]:     </serial>
Oct 17 11:45:58 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:45:58 user nova-compute[74261]:     <video>
Oct 17 11:45:58 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:45:58 user nova-compute[74261]:     </video>
Oct 17 11:45:58 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:45:58 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:45:58 user nova-compute[74261]:     </rng>
Oct 17 11:45:58 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:45:58 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:45:58 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:45:58 user nova-compute[74261]:     </memballoon>
Oct 17 11:45:58 user nova-compute[74261]:   </devices>
Oct 17 11:45:58 user nova-compute[74261]: </domain>
Oct 17 11:45:58 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-857782247',display_name='tempest-ServersNegativeTestJSON-server-857782247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-857782247',id=12,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8bd718919439f8a804d2b74561f1d',ramdisk_id='',reservation_id='r-q0gifj99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086864809',owner_user_name='tempest-ServersNegativeTestJSON-1086864809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:45:56Z,user_data=None,user_id='57dc5550d0fb4f0f8aaf2633b1ad6095',uuid=bdf1a49d-31bc-4d33-90cc-1837754cfcee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converting VIF {"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG os_vif [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05de13da-10be-5a14-905c-5c23f7365ed2', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7e5ec38-37, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7e5ec38-37, col_values=(('qos', UUID('229415dd-4193-4b64-ae4d-a363569e439f')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7e5ec38-37, col_values=(('external_ids', {'iface-id': 'a7e5ec38-3701-473a-a517-bc04f0030180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:7d:40', 'vm-uuid': 'bdf1a49d-31bc-4d33-90cc-1837754cfcee'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:58 user nova-compute[74261]: INFO os_vif [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37')
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] No VIF found with MAC fa:16:3e:89:7d:40, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.neutron [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updated VIF entry in instance network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.neutron [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-577cde92-fe79-4137-9e40-586f3909e235 req-7ce8dd06-3eee-4b14-b783-067a20c9afef service nova] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.neutron [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Updated VIF entry in instance network info cache for port a7e5ec38-3701-473a-a517-bc04f0030180. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.network.neutron [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Updating instance_info_cache with network_info: [{"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d1ddf5fc-058c-41c9-bf22-dffa8d248004 req-3076cc7b-22e9-4b3d-a468-5f700767a35f service nova] Releasing lock "refresh_cache-bdf1a49d-31bc-4d33-90cc-1837754cfcee" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:45:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:45:58 user nova-compute[74261]: INFO nova.compute.manager [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] instance snapshotting
Oct 17 11:45:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Beginning live snapshot process
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lazy-loading 'flavor' on Instance uuid f92dc0ae-f230-43b3-8020-1e22ccb1d491 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:45:59 user nova-compute[74261]: INFO nova.compute.manager [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Attaching volume d7a968fb-85a1-4371-aa1b-39c263b10ece to /dev/vdb
Oct 17 11:45:59 user nova-compute[74261]: DEBUG os_brick.utils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:45:59 user nova-compute[74261]: INFO oslo.privsep.daemon [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3yw8a5l0/privsep.sock']
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:59 user sudo[85935]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3yw8a5l0/privsep.sock
Oct 17 11:45:59 user sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 17 11:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp29udlxce/6e23a3d940494b5b92dd0f0d397efec0.delta 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:45:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp29udlxce/6e23a3d940494b5b92dd0f0d397efec0.delta 1073741824" returned: 0 in 0.067s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:45:59 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 11:45:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74261) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 17 11:45:59 user nova-compute[74261]: INFO nova.virt.libvirt.host [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] UEFI support detected
Oct 17 11:46:00 user nova-compute[74261]: DEBUG nova.compute.manager [req-e2099d70-b267-45ee-b2f4-0c4963a02b94 req-b68c9771-880d-4dea-94ae-f922f0730869 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2099d70-b267-45ee-b2f4-0c4963a02b94 req-b68c9771-880d-4dea-94ae-f922f0730869 service nova] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2099d70-b267-45ee-b2f4-0c4963a02b94 req-b68c9771-880d-4dea-94ae-f922f0730869 service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2099d70-b267-45ee-b2f4-0c4963a02b94 req-b68c9771-880d-4dea-94ae-f922f0730869 service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG nova.compute.manager [req-e2099d70-b267-45ee-b2f4-0c4963a02b94 req-b68c9771-880d-4dea-94ae-f922f0730869 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] No waiting events found dispatching network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:00 user nova-compute[74261]: WARNING nova.compute.manager [req-e2099d70-b267-45ee-b2f4-0c4963a02b94 req-b68c9771-880d-4dea-94ae-f922f0730869 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received unexpected event network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 for instance with vm_state building and task_state spawning.
Oct 17 11:46:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:46:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:46:01 user sudo[85935]: pam_unix(sudo:session): session closed for user root
Oct 17 11:46:01 user nova-compute[74261]: INFO oslo.privsep.daemon [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Spawned new privsep daemon via rootwrap
Oct 17 11:46:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 17 11:46:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 17 11:46:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 17 11:46:01 user nova-compute[74261]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86003
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:46:01 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[961363b9-2e8f-4078-a06b-43ac1c954fcc]: (2,) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp29udlxce/6e23a3d940494b5b92dd0f0d397efec0.delta /opt/stack/data/nova/instances/snapshots/tmp29udlxce/6e23a3d940494b5b92dd0f0d397efec0 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce94534-91b3-4773-a067-8c1fe5e82650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:01 user nova-compute[74261]: WARNING os_brick.initiator.connectors.nvmeof [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd74bc3-a485-4b3c-9894-94b97d4dfc94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243a1bf-b1bd-4bd3-bb90-3d648dcd50ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e0bd6-7bf1-473f-aed7-7b9fa232d42f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:01 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52061158-13ff-48d5-8bc5-5bb7cc9c49b8]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG os_brick.utils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] <== get_connector_properties: return (2228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updating existing volume attachment record: 6300cef7-dfcd-4525-b610-47a31cc49002 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] No waiting events found dispatching network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:02 user nova-compute[74261]: WARNING nova.compute.manager [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received unexpected event network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 for instance with vm_state building and task_state spawning.
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-changed-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Refreshing instance network info cache due to event network-changed-af15dff2-7dd0-449e-9cfa-9ae2135a43d4. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Refreshing network info cache for port af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp29udlxce/6e23a3d940494b5b92dd0f0d397efec0.delta /opt/stack/data/nova/instances/snapshots/tmp29udlxce/6e23a3d940494b5b92dd0f0d397efec0" returned: 0 in 0.574s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Snapshot extracted, beginning image upload
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updated VIF entry in instance network info cache for port af15dff2-7dd0-449e-9cfa-9ae2135a43d4. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c03e657-ac6d-4ab6-91b4-21586ed881a2 req-5c59713f-a389-4231-9dfd-e1826eabecb0 service nova] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Instance spawned successfully.
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:03 user nova-compute[74261]: INFO nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Took 6.84 seconds to spawn the instance on the hypervisor.
Oct 17 11:46:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:46:03 user nova-compute[74261]: INFO nova.compute.manager [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Took 7.75 seconds to build instance.
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8f1313ba-69c1-4bf5-98ec-52841729fc5c tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.869s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-changed-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Refreshing instance network info cache due to event network-changed-eb17ef68-792f-4ebb-aff8-d18cb41cb992. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] Acquiring lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] Acquired lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Refreshing network info cache for port eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updated VIF entry in instance network info cache for port eb17ef68-792f-4ebb-aff8-d18cb41cb992. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updating instance_info_cache with network_info: [{"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9603fb0c-d4c8-40db-aa30-f6701d10d5cb req-d05e867b-7e04-4e70-a745-ba0ea6bf202b service nova] Releasing lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:05 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Snapshot image upload complete
Oct 17 11:46:05 user nova-compute[74261]: INFO nova.compute.manager [None req-8a1bb17e-019a-402b-bee7-4f238b69a053 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Took 6.59 seconds to snapshot the instance on the hypervisor.
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:07 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:46:07 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:46:07 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=6804MB free_disk=25.552684783935547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f92dc0ae-f230-43b3-8020-1e22ccb1d491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance bfccfe8a-4414-44b0-9e94-12b6f7003406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d0bc8ec6-6f50-4013-a360-71c64069ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance ea0ea436-4137-4c76-b12b-9d68f8646825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance bdf1a49d-31bc-4d33-90cc-1837754cfcee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:08 user nova-compute[74261]: INFO nova.compute.manager [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Attaching volume 404c28d5-d363-40eb-8b0d-94ea33bf54ab to /dev/vdb
Oct 17 11:46:08 user nova-compute[74261]: DEBUG os_brick.utils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b080b0-8080-4799-b7fe-607a65e2825c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb5ab11-c7f4-4b6f-aede-3c31fa8997ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a532aa6-3a70-4d32-b5b5-6e8444b42338]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[194bc83d-9c10-497d-97d0-ddba25b92b08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:08 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee0aca4-6d0d-4bcb-87e9-b6f16f98dfba]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG os_brick.utils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating existing volume attachment record: 7244a418-b6e5-454c-b1c5-2a8d67923bf8 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:46:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.908s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-changed-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Refreshing instance network info cache due to event network-changed-dfb329d0-1c06-4db5-bc81-d62689969318. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] Acquiring lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] Acquired lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Refreshing network info cache for port dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updated VIF entry in instance network info cache for port dfb329d0-1c06-4db5-bc81-d62689969318. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updating instance_info_cache with network_info: [{"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5736a847-bd13-4274-a59d-9f9c3e46ef24 req-3c0fa21e-88e7-4031-b15c-6387a1ec8904 service nova] Releasing lock "refresh_cache-0a037120-c55a-4394-99f2-7c1d6e5664b7" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:18 user nova-compute[74261]: DEBUG nova.objects.instance [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'flavor' on Instance uuid 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:19 user nova-compute[74261]: INFO nova.compute.manager [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Attaching volume 493be656-2e73-4d3b-8acc-9080ff657be0 to /dev/vdb
Oct 17 11:46:19 user nova-compute[74261]: DEBUG os_brick.utils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b124940-6e74-4c48-b9e0-7adc8d43fe73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983774d-bca8-428f-ba33-bb1c1f32738c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64d078c-f0bc-4bed-ba4d-ff4eff43f0ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9007e168-0b69-441e-979a-ff5f1751b742]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:19 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e879454-bc3b-43a1-b4f0-296413db1754]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG os_brick.utils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:19 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updating existing volume attachment record: 42050a52-5849-4721-95cd-9956296e5e62 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-changed-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Refreshing instance network info cache due to event network-changed-cfa28e8b-9db3-4a3f-9e38-535542e7b371. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] Acquiring lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] Acquired lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Refreshing network info cache for port cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updated VIF entry in instance network info cache for port cfa28e8b-9db3-4a3f-9e38-535542e7b371. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updating instance_info_cache with network_info: [{"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1559d69b-2036-46c4-9955-f6f5b855cea6 req-5a97c166-2069-4c65-9bc6-3547f2cc08fc service nova] Releasing lock "refresh_cache-30bf8e80-b31c-44b5-b98e-d754cb3eff8b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-changed-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Refreshing instance network info cache due to event network-changed-c52b809b-bc53-45bf-b53d-58b724efacf7. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] Acquiring lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] Acquired lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG nova.network.neutron [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Refreshing network info cache for port c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG nova.network.neutron [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updated VIF entry in instance network info cache for port c52b809b-bc53-45bf-b53d-58b724efacf7. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG nova.network.neutron [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ec6aa4e-9b3a-4b6e-b654-d86fa989aaf4 req-28c191bf-6fd4-40f8-8bbf-8bc7f186271c service nova] Releasing lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "interface-bfccfe8a-4414-44b0-9e94-12b6f7003406-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "interface-bfccfe8a-4414-44b0-9e94-12b6f7003406-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG nova.objects.instance [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'flavor' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG nova.objects.instance [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'pci_requests' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG nova.objects.base [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Object Instance<bfccfe8a-4414-44b0-9e94-12b6f7003406> lazy-loaded attributes: flavor,pci_requests {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG nova.policy [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6a380973f1c4684b1dca8d8ec8de410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b1386d00864d748f658ae72455d6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:46:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Successfully created port: 9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG nova.network.neutron [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Successfully updated port: 9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquired lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG nova.network.neutron [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-changed-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Refreshing instance network info cache due to event network-changed-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] Acquiring lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Releasing lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] Acquired lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Refreshing network info cache for port 9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG os_vif [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b69b369-f7f4-5229-abf3-87ce76dc9212', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c92b46a-db, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c92b46a-db, col_values=(('qos', UUID('3a78d7b5-2b2b-4373-b755-2b0247c4684b')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c92b46a-db, col_values=(('external_ids', {'iface-id': '9c92b46a-dbfa-4d44-89c8-48444dbc4d9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b0:9c', 'vm-uuid': 'bfccfe8a-4414-44b0-9e94-12b6f7003406'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: INFO os_vif [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db')
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] attach device xml: <interface type="ethernet">
Oct 17 11:46:30 user nova-compute[74261]:   <mac address="fa:16:3e:6d:b0:9c"/>
Oct 17 11:46:30 user nova-compute[74261]:   <model type="virtio"/>
Oct 17 11:46:30 user nova-compute[74261]:   <mtu size="1442"/>
Oct 17 11:46:30 user nova-compute[74261]:   <target dev="tap9c92b46a-db"/>
Oct 17 11:46:30 user nova-compute[74261]: </interface>
Oct 17 11:46:30 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updated VIF entry in instance network info cache for port 9c92b46a-dbfa-4d44-89c8-48444dbc4d9b. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c40a7e34-67da-4867-8ec4-25661a1351ee req-b14970c0-e0ef-47d0-aa30-c9554f8e2727 service nova] Releasing lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-4c536a95-239f-47b2-9e24-9f7bb8f042b5 req-d89e004c-8de9-4404-8e41-2f7cee8bb891 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4c536a95-239f-47b2-9e24-9f7bb8f042b5 req-d89e004c-8de9-4404-8e41-2f7cee8bb891 service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4c536a95-239f-47b2-9e24-9f7bb8f042b5 req-d89e004c-8de9-4404-8e41-2f7cee8bb891 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4c536a95-239f-47b2-9e24-9f7bb8f042b5 req-d89e004c-8de9-4404-8e41-2f7cee8bb891 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-4c536a95-239f-47b2-9e24-9f7bb8f042b5 req-d89e004c-8de9-4404-8e41-2f7cee8bb891 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:30 user nova-compute[74261]: WARNING nova.compute.manager [req-4c536a95-239f-47b2-9e24-9f7bb8f042b5 req-d89e004c-8de9-4404-8e41-2f7cee8bb891 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b for instance with vm_state active and task_state None.
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No BDM found with device name hda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No VIF found with MAC fa:16:3e:44:d7:13, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:46:30 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:46:30 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:46:30 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:46:30</nova:creationTime>
Oct 17 11:46:30 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:46:30 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:46:30 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:46:30 user nova-compute[74261]:   <nova:owner>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:46:30 user nova-compute[74261]:   </nova:owner>
Oct 17 11:46:30 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:46:30 user nova-compute[74261]:   <nova:ports>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:46:30 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:46:30 user nova-compute[74261]:     </nova:port>
Oct 17 11:46:30 user nova-compute[74261]:     <nova:port uuid="9c92b46a-dbfa-4d44-89c8-48444dbc4d9b">
Oct 17 11:46:30 user nova-compute[74261]:       <nova:ip type="fixed" address="10.10.10.137" ipVersion="4"/>
Oct 17 11:46:30 user nova-compute[74261]:     </nova:port>
Oct 17 11:46:30 user nova-compute[74261]:   </nova:ports>
Oct 17 11:46:30 user nova-compute[74261]: </nova:instance>
Oct 17 11:46:30 user nova-compute[74261]:  {{(pid=74261) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-51926064-5c86-4b5d-808a-2d14e58533a1 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "interface-bfccfe8a-4414-44b0-9e94-12b6f7003406-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.838s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-changed-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Refreshing instance network info cache due to event network-changed-1774a9a4-4e0b-473a-9c1d-cc03100e96b4. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] Acquiring lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] Acquired lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:31 user nova-compute[74261]: DEBUG nova.network.neutron [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Refreshing network info cache for port 1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG nova.network.neutron [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updated VIF entry in instance network info cache for port 1774a9a4-4e0b-473a-9c1d-cc03100e96b4. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG nova.network.neutron [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updating instance_info_cache with network_info: [{"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9333a9c-d675-4a6b-8e78-1470e4b4d41c req-2a307133-529e-4d9e-b8e6-7befe89e3ae1 service nova] Releasing lock "refresh_cache-d0bc8ec6-6f50-4013-a360-71c64069ed2f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-4e578dd3-26ae-48fc-b43c-c8aed1695cac req-79e847ab-46ee-4ab3-be25-8b00c6588018 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4e578dd3-26ae-48fc-b43c-c8aed1695cac req-79e847ab-46ee-4ab3-be25-8b00c6588018 service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4e578dd3-26ae-48fc-b43c-c8aed1695cac req-79e847ab-46ee-4ab3-be25-8b00c6588018 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4e578dd3-26ae-48fc-b43c-c8aed1695cac req-79e847ab-46ee-4ab3-be25-8b00c6588018 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-4e578dd3-26ae-48fc-b43c-c8aed1695cac req-79e847ab-46ee-4ab3-be25-8b00c6588018 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:32 user nova-compute[74261]: WARNING nova.compute.manager [req-4e578dd3-26ae-48fc-b43c-c8aed1695cac req-79e847ab-46ee-4ab3-be25-8b00c6588018 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b for instance with vm_state active and task_state None.
Oct 17 11:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connector [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Factory for ISCSI on None {{(pid=74261) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaAdfESs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:35 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:35 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:35 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f2001d-8d4e-4cd5-9186-69dcfd82b22d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:46:35 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd25951-81e7-4106-88d1-32ce071c49f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0] added
Oct 17 11:46:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8576d4d7-9416-41b4-8084-ed93283ebfdc]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f92714-5b6e-47c8-8758-a080b5bca965]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaAdfESs {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaAdfESs" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5cd7f8-fb2d-47b7-ba9d-4bcb93ace74d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaAdfESs'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0880c56f-7319-4ea4-9304-c84f325eaefc]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51b5fb5-647d-4816-a1f5-dd7ecee43b19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 11:46:35 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 11:46:35 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:35 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 11:46:35 user nova-compute[74261]: 
Oct 17 11:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --login" returned: 0 in 0.155s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da6bd7-7a43-4f90-afc0-1fb86deae1f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260]
Oct 17 11:46:36 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5e3184-183f-48ef-9df6-b7fbc029a5f2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea4018-abd1-4ed1-94ee-aaa336da0c93]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1a128b-b5dc-487c-a10b-e72d04f99c5f]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lazy-loading 'flavor' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lazy-loading 'flavor' on Instance uuid ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG nova.objects.instance [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'flavor' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.447s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.434s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.446s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:37 user nova-compute[74261]: INFO nova.compute.manager [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Attaching volume 731b9014-4c69-45bb-a259-af5e67f2a74c to /dev/vdb
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-changed-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Refreshing instance network info cache due to event network-changed-b0662753-f337-4936-ac4f-6dd0f83f7bfb. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] Acquiring lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] Acquired lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.network.neutron [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Refreshing network info cache for port b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaAdfESs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23838363132356135', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838363132356135', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.objects.instance [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'flavor' on Instance uuid 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:46:37 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:37 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:46:37 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:37 user nova-compute[74261]:   <serial>493be656-2e73-4d3b-8acc-9080ff657be0</serial>
Oct 17 11:46:37 user nova-compute[74261]: </disk>
Oct 17 11:46:37 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:37 user nova-compute[74261]: INFO nova.compute.manager [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Attaching volume 9765396d-ef92-4472-b087-0eaab5cc64b8 to /dev/vdb
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:37 user nova-compute[74261]: INFO nova.compute.manager [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Attaching volume 74446115-2d56-49e8-ba4a-bd15e12361df to /dev/vdb
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391f1cb-dd87-493d-9f3b-7b75122c268c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2fbb4-f255-4adb-b75d-9bd3ab6e1f4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd709d2-e3a5-4dd1-948d-f5e0efb4fabd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7483e2b-8454-4c8d-9143-49a7c261126d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb3b24-5bb6-4775-893f-ac47506003e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.network.neutron [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updated VIF entry in instance network info cache for port b0662753-f337-4936-ac4f-6dd0f83f7bfb. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.network.neutron [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updating instance_info_cache with network_info: [{"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:37 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e29c7a-310a-4c02-99ba-815a492fa14d]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updating existing volume attachment record: 979fa19f-d75d-425c-9484-1e02d332c4c2 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c269d158-b99d-496f-a2da-d79949071837]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c91d79b6-faa5-4aa5-bacc-88b18fb50439 req-e1f95764-982c-43bc-ab99-cbaf44f03e5f service nova] Releasing lock "refresh_cache-ea0ea436-4137-4c76-b12b-9d68f8646825" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6e333-fe70-4a9f-8af3-b6e1df3be671]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7f040a-44a6-477e-94af-1ed84a2dcc5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c50d832-0962-469a-b71c-e9dc99465332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No VIF found with MAC fa:16:3e:9b:21:d4, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:37 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09aa244-2a0b-48d6-a7ed-b703ca545b14]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating existing volume attachment record: f94e0b03-194f-47af-bd29-0e5354c82bbe {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e83cd9-47a0-4004-a3a2-9ade2798204d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e79e0-0b0a-469b-ba16-5cfee6928482]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[67386963-c2c7-4597-8cfe-4890d9ec3fc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:37 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e255ff-ec28-4fa2-bfa6-f6012969a1da]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:37 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updating existing volume attachment record: a089ba1e-e49f-4873-8f82-e3fe1dfc913c {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwXkuYpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:40 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5706b5-6999-4069-bb26-f4dd485aff48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:46:40 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a78e21-2c34-4f26-8d90-68704de09b30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece] added
Oct 17 11:46:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d106781-aec3-4764-9fc7-022e40ed5714]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b71bbd-e1f0-43a3-a0e3-04922bfb1cb2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwXkuYpL {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwXkuYpL" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce90af-242c-434d-8a3b-f8024f1db07a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OwXkuYpL'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d043e338-f1c5-45ca-ae67-65cfa924f0b9]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c79970-dcb7-4308-89ed-1019f50fce5e]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca8156-9252-4954-ba8a-e05cbf56c74f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260]
Oct 17 11:46:40 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f43009c-da41-4bef-8eda-802b3d6f99fe]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9959bbb1-090c-4f5a-95cf-7ccdb49267c1 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.630s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[70937abf-8561-4d01-992a-7145a4b436f9]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:40 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:40 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] HCTL ('34', '-', '-', 0) found on session 2 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529219a-24e6-4491-bc96-ec6cf608b002]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Searching for a device in session 2 and hctl ['34', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Searching for a device in session 2 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwXkuYpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26565383562626333', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565383562626333', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.179s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:41 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:41 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lazy-loading 'flavor' on Instance uuid f92dc0ae-f230-43b3-8020-1e22ccb1d491 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf236cba-8a97-4663-8571-19cdde1e7085]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:46:41 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:46:41 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:41 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:46:41 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:41 user nova-compute[74261]:   <serial>d7a968fb-85a1-4371-aa1b-39c263b10ece</serial>
Oct 17 11:46:41 user nova-compute[74261]: </disk>
Oct 17 11:46:41 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de8da2-f316-4746-94b1-b4873e4e446d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab] added
Oct 17 11:46:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a59bb4-9f1c-4bcf-9570-34382bb45c94]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d7be0-d173-449c-b56b-06588ad5cb00]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DexHRSiB {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DexHRSiB" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a722d4-6f60-420c-b130-7bfbc7788fa3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DexHRSiB'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[50874db2-7c7d-4d77-bb9e-52c6e013059f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c0570-d3d8-4f20-8994-035e83e273d2]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:41 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:41 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[867624f4-b8ec-4f29-adbc-55c78c8d7db6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]
Oct 17 11:46:41 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b22d1dd-4fae-430d-b2b4-1eceef26999c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f809b9-8da2-498f-9f50-3969ff1b7962]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:41 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:41 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:41 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:41 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] HCTL ('35', '-', '-', 0) found on session 3 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c24f83-2944-4f3d-880a-afa0e2ed5a78]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching for a device in session 3 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] No VIF found with MAC fa:16:3e:fc:42:79, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== connect_volume: return (2485ms) {'type': 'block', 'scsi_wwn': '23333363231323263', 'path': '/dev/sdd'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333363231323263', 'path': '/dev/sdd'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:46:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:46:43 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:43 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 11:46:43 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:43 user nova-compute[74261]:   <serial>404c28d5-d363-40eb-8b0d-94ea33bf54ab</serial>
Oct 17 11:46:43 user nova-compute[74261]: </disk>
Oct 17 11:46:43 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:46:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No VIF found with MAC fa:16:3e:83:f7:64, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:46:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:54 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab91af0-0e21-468e-b7cc-b4f2d58b6359]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:46:54 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006868d-d3c9-4d9b-882e-da469cb57453]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c] added
Oct 17 11:46:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd0dea-e766-4f56-a774-7b57a54ead78]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[740f1197-da50-4a60-9966-22b10c08dc0f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOLbhCWF {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOLbhCWF" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c33c1d-f92a-4510-91dc-e0b196628911]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOLbhCWF'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9cb7d0-5c50-4800-a2b5-ddfdcf36dd0b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff953c39-5927-463a-bfc4-321145a69275]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:54 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:54 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:54 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:54 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54834a24-d16c-48a0-a959-590591cac730]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]
Oct 17 11:46:54 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cdec2-f972-4ac5-889a-7ca7265ffc60]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab330dc1-151e-4cdb-b4cb-00146c9f4fca]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:55 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:55 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:55 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:55 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:55 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:55 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] HCTL ('36', '-', '-', 0) found on session 4 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb0bfcb-57f3-4292-becc-03e64288d424]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Searching for a device in session 4 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9f3f613-3124-4276-9e1f-37560d87dec2 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.633s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8025411-89da-4bcf-b71d-5ce8b4d4547b tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.906s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lazy-loading 'flavor' on Instance uuid 30bf8e80-b31c-44b5-b98e-d754cb3eff8b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:55 user nova-compute[74261]: INFO nova.compute.manager [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Attaching volume 771edd3b-dd80-43ad-94bb-0d2f7c56740c to /dev/sdc
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.utils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23530623638383764', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530623638383764', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lazy-loading 'flavor' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[90069cd6-de7d-4b69-9cb3-8e849bc0f733]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:46:56 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:56 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:46:56 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:56 user nova-compute[74261]:   <serial>731b9014-4c69-45bb-a259-af5e67f2a74c</serial>
Oct 17 11:46:56 user nova-compute[74261]: </disk>
Oct 17 11:46:56 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f8f8e-76dc-4442-ab18-ae681f9539b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bf99d7-daab-41e2-83e6-749b50d59dfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b9f0ed-b020-41e3-a665-a3418af71516]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:56 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb32e7c-8165-4618-bea9-8e8ebe703369]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG os_brick.utils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updating existing volume attachment record: 516de5fb-55a5-4e70-8070-16991ca1bff3 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:56 user nova-compute[74261]: INFO nova.compute.manager [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Terminating instance
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:46:56 user nova-compute[74261]: INFO nova.compute.manager [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Detaching volume 493be656-2e73-4d3b-8acc-9080ff657be0
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] No VIF found with MAC fa:16:3e:f6:69:19, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74261) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-c733667e-179b-4de2-b588-c43822f4e22f req-517512c6-821e-4a07-a000-9f2216b8fa0f service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-unplugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c733667e-179b-4de2-b588-c43822f4e22f req-517512c6-821e-4a07-a000-9f2216b8fa0f service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c733667e-179b-4de2-b588-c43822f4e22f req-517512c6-821e-4a07-a000-9f2216b8fa0f service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c733667e-179b-4de2-b588-c43822f4e22f req-517512c6-821e-4a07-a000-9f2216b8fa0f service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-c733667e-179b-4de2-b588-c43822f4e22f req-517512c6-821e-4a07-a000-9f2216b8fa0f service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-unplugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-c733667e-179b-4de2-b588-c43822f4e22f req-517512c6-821e-4a07-a000-9f2216b8fa0f service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-unplugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-10765733-b676-41a0-9b2b-7935f0579f81 req-f4195ecd-f615-44f6-bb3a-8d1cc713bf9f service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-10765733-b676-41a0-9b2b-7935f0579f81 req-f4195ecd-f615-44f6-bb3a-8d1cc713bf9f service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-10765733-b676-41a0-9b2b-7935f0579f81 req-f4195ecd-f615-44f6-bb3a-8d1cc713bf9f service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-10765733-b676-41a0-9b2b-7935f0579f81 req-f4195ecd-f615-44f6-bb3a-8d1cc713bf9f service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-10765733-b676-41a0-9b2b-7935f0579f81 req-f4195ecd-f615-44f6-bb3a-8d1cc713bf9f service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:56 user nova-compute[74261]: WARNING nova.compute.manager [req-10765733-b676-41a0-9b2b-7935f0579f81 req-f4195ecd-f615-44f6-bb3a-8d1cc713bf9f service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state active and task_state powering-off.
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Instance destroyed successfully.
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.objects.instance [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lazy-loading 'resources' on Instance uuid f92dc0ae-f230-43b3-8020-1e22ccb1d491 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1175586043',display_name='tempest-DeleteServersTestJSON-server-1175586043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1175586043',id=1,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcbde52958424fc2a4d69eee128c595d',ramdisk_id='',reservation_id='r-rp5p5emr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-233391474',owner_user_name='tempest-DeleteServersTestJSON-233391474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:13Z,user_data=None,user_id='5bf90277d773477eb663a3a96f1cdc21',uuid=f92dc0ae-f230-43b3-8020-1e22ccb1d491,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Converting VIF {"id": "0ba8688f-956b-4db7-81e5-41366eec22db", "address": "fa:16:3e:fc:42:79", "network": {"id": "287781ff-37df-4c57-befb-f08aec11ecb7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2032652024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcbde52958424fc2a4d69eee128c595d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba8688f-95", "ovs_interfaceid": "0ba8688f-956b-4db7-81e5-41366eec22db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_vif [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ba8688f-95, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:46:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance destroyed successfully.
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45d539e2-d2cc-443c-9ad5-69506a2feda5) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: INFO os_vif [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:42:79,bridge_name='br-int',has_traffic_filtering=True,id=0ba8688f-956b-4db7-81e5-41366eec22db,network=Network(287781ff-37df-4c57-befb-f08aec11ecb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba8688f-95')
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwXkuYpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b9575c-6809-4d82-a096-7f82ed362188]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:46:57 user nova-compute[74261]: No targets found.
Oct 17 11:46:57 user nova-compute[74261]: iSNS:
Oct 17 11:46:57 user nova-compute[74261]: No targets found.
Oct 17 11:46:57 user nova-compute[74261]: STATIC:
Oct 17 11:46:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:46:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:46:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:46:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0
Oct 17 11:46:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:46:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:46:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:46:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:46:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:46:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece
Oct 17 11:46:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:46:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:46:57 user nova-compute[74261]: FIRMWARE:
Oct 17 11:46:57 user nova-compute[74261]: No targets found.
Oct 17 11:46:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:46:57 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:46:57 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56852de8-d823-4aa2-8fd0-3e4cfd93f75c tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.243s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def41f0-8ddc-4a8f-ac04-6f3e1220291a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c81ae4-c046-4525-9cd7-ec022d33d389]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:57 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:57 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:57 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:57 user nova-compute[74261]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece (non-flash)
Oct 17 11:46:57 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:57 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24230310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c2424-f6d4-4642-99d9-40d8724c7b02]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXPTAhRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1304dfd-c1cc-4810-b59a-dfd3851bb4c9]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.043s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e58a537-ce6c-4b4c-abfe-756682c079a6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f7cd6-6f1d-48ee-bef9-9e7722b51ca8]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3e9399bf-7817-484c-b2bd-e5f955ab1bd7 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.869s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dbc231-a19f-459f-8f09-1d82bcbadc4b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa6b052-8bfb-4f7e-92fc-e78ea6789c5a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260]
Oct 17 11:46:58 user nova-compute[74261]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a968fb-85a1-4371-aa1b-39c263b10ece -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dc979e-4ad7-4f6a-a73f-55794ae56fc4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] <== disconnect_volume: return (424ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:46:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Deleting instance files /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491_del
Oct 17 11:46:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Deletion of /opt/stack/data/nova/instances/f92dc0ae-f230-43b3-8020-1e22ccb1d491_del complete
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.284s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:58 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca84ab2-7c5b-4b64-8b3d-6964f627c18b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:46:58 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab3a0f-c991-49de-87af-80045728a971]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8] added
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: INFO nova.compute.manager [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Took 1.77 seconds to destroy the instance on the hypervisor.
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4f2d1-dbb7-4bc3-93b5-ffdd85072ab4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDEygdZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0d7194-7ac6-4478-b8f1-1369605b84a8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXPTAhRj {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXPTAhRj" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f506e8-8aa8-43fd-9799-73c23e095b45]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXPTAhRj'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: INFO nova.virt.block_device [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Attempting to driver detach volume 493be656-2e73-4d3b-8acc-9080ff657be0 from mountpoint /dev/vdb
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Attempting to detach device vdb from instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:46:58 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:58 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:46:58 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:58 user nova-compute[74261]:   <serial>493be656-2e73-4d3b-8acc-9080ff657be0</serial>
Oct 17 11:46:58 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:46:58 user nova-compute[74261]: </disk>
Oct 17 11:46:58 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9304c-3850-4d2f-86d7-7d2233020327]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Successfully detached device vdb from instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 from the persistent domain config.
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:46:58 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:58 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:46:58 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:58 user nova-compute[74261]:   <serial>493be656-2e73-4d3b-8acc-9080ff657be0</serial>
Oct 17 11:46:58 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:46:58 user nova-compute[74261]: </disk>
Oct 17 11:46:58 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe38ed6-bf0d-4151-a076-bf978f3bd4d8]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69bb7a-88c5-48be-bec9-570a70bd17cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260]
Oct 17 11:46:58 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e802e6-296c-4fce-917a-d061de02f426]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3bd1a8-c055-4049-92cc-ed64acc9094b]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:58 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:46:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b990a-3963-435e-a052-c64952e1da91]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXPTAhRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.utils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f6794-b37c-4123-a1d6-13301a3e6a6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8cf96-ce28-44f0-a599-872e3faae825]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[10647509-61ff-4a12-9b65-458dbab5c595]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f7e703-0ee0-4561-896a-2fa667666a52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received unexpected event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with vm_state active and task_state deleting.
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received unexpected event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with vm_state active and task_state deleting.
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received unexpected event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with vm_state active and task_state deleting.
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-unplugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-unplugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-unplugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Acquiring lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] No waiting events found dispatching network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING nova.compute.manager [req-994759d8-46b8-4767-a064-2ee81771b443 req-f43d1b70-4507-4326-ac49-3aed8cd8dcce service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received unexpected event network-vif-plugged-0ba8688f-956b-4db7-81e5-41366eec22db for instance with vm_state active and task_state deleting.
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d091293-a1f7-4431-8bb4-b70091188e4d]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.utils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-498e15aa-8ac3-46f3-8624-202824b6e6e1 req-ae6a00f2-e0ad-4d97-9274-76f5e681bae2 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Received event network-vif-deleted-0ba8688f-956b-4db7-81e5-41366eec22db {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:59 user nova-compute[74261]: INFO nova.compute.manager [req-498e15aa-8ac3-46f3-8624-202824b6e6e1 req-ae6a00f2-e0ad-4d97-9274-76f5e681bae2 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Neutron deleted interface 0ba8688f-956b-4db7-81e5-41366eec22db; detaching it from the instance and deleting it from the info cache
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.network.neutron [req-498e15aa-8ac3-46f3-8624-202824b6e6e1 req-ae6a00f2-e0ad-4d97-9274-76f5e681bae2 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:46:59 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Took 0.81 seconds to deallocate network for instance.
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-498e15aa-8ac3-46f3-8624-202824b6e6e1 req-ae6a00f2-e0ad-4d97-9274-76f5e681bae2 service nova] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Detach interface failed, port_id=0ba8688f-956b-4db7-81e5-41366eec22db, reason: Instance f92dc0ae-f230-43b3-8020-1e22ccb1d491 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-c4986a7b-6f62-43b0-905b-967e51d75a32 req-1cd78fdd-b7d5-48f5-a902-f75e3ce6bb91 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4986a7b-6f62-43b0-905b-967e51d75a32 req-1cd78fdd-b7d5-48f5-a902-f75e3ce6bb91 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4986a7b-6f62-43b0-905b-967e51d75a32 req-1cd78fdd-b7d5-48f5-a902-f75e3ce6bb91 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4986a7b-6f62-43b0-905b-967e51d75a32 req-1cd78fdd-b7d5-48f5-a902-f75e3ce6bb91 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-c4986a7b-6f62-43b0-905b-967e51d75a32 req-1cd78fdd-b7d5-48f5-a902-f75e3ce6bb91 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING nova.compute.manager [req-c4986a7b-6f62-43b0-905b-967e51d75a32 req-1cd78fdd-b7d5-48f5-a902-f75e3ce6bb91 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state stopped and task_state None.
Oct 17 11:46:59 user nova-compute[74261]: INFO nova.compute.manager [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Swapping volume 731b9014-4c69-45bb-a259-af5e67f2a74c for 581268bb-0446-41d6-8235-9e49d911ff87
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] <== connect_volume: return (1657ms) {'type': 'block', 'scsi_wwn': '26138333338643934', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138333338643934', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.270s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:46:59 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'flavor' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[faba1604-63c9-4008-b075-82425ce173fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:46:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:46:59 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:46:59 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:46:59 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:46:59 user nova-compute[74261]:   <serial>9765396d-ef92-4472-b087-0eaab5cc64b8</serial>
Oct 17 11:46:59 user nova-compute[74261]: </disk>
Oct 17 11:46:59 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[554b5bf5-7852-4376-af67-709f9d7d962a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df] added
Oct 17 11:46:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdc0783-67a7-42b8-b61a-044ffd9e62fc]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5301d5-18e8-4676-91aa-92393a889835]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDEygdZt {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDEygdZt" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7309221-bcdc-4a0e-81d4-7d41e2a9de49]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDEygdZt'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5cb27-f3c0-4261-bb13-27e602bb9f10]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e6a8ac-7a15-4084-8fa5-32514cee72f0]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07aba3b-b941-4df8-850a-fed0fd37e73b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260]
Oct 17 11:46:59 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260] successful.
Oct 17 11:46:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ca591-8d91-4ca2-abee-b1e921dd25bf]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5923214a-36ce-42f1-8484-7e016585ba99]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:46:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:46:59 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:46:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fccabaa-90fa-4bf7-8ddc-4ea2b4efe428]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDEygdZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:46:59 user nova-compute[74261]: INFO nova.compute.manager [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] [instance: f92dc0ae-f230-43b3-8020-1e22ccb1d491] Took 0.87 seconds to detach 1 volumes for instance.
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:46:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No BDM found with device name hda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] No VIF found with MAC fa:16:3e:44:d7:13, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-40bedd62-c5f3-4a0e-b5c4-a30c7b8f8ca3 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.959s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:00 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Deleted allocations for instance f92dc0ae-f230-43b3-8020-1e22ccb1d491
Oct 17 11:47:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-751fd68e-dd18-43f7-8d04-4f4790164b00 tempest-DeleteServersTestJSON-233391474 tempest-DeleteServersTestJSON-233391474-project-member] Lock "f92dc0ae-f230-43b3-8020-1e22ccb1d491" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.155s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] <== connect_volume: return (2635ms) {'type': 'block', 'scsi_wwn': '23866623833393632', 'path': '/dev/sdf'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866623833393632', 'path': '/dev/sdf'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lazy-loading 'flavor' on Instance uuid ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] attach device xml: <disk type="block" device="disk">
Oct 17 11:47:00 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:00 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 11:47:00 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:47:00 user nova-compute[74261]:   <serial>74446115-2d56-49e8-ba4a-bd15e12361df</serial>
Oct 17 11:47:00 user nova-compute[74261]: </disk>
Oct 17 11:47:00 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] No VIF found with MAC fa:16:3e:44:66:b0, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e23094a4-284a-418f-9316-929baee956f6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.166s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:01 user nova-compute[74261]: INFO nova.compute.manager [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Detaching volume 9765396d-ef92-4472-b087-0eaab5cc64b8
Oct 17 11:47:01 user nova-compute[74261]: INFO nova.virt.block_device [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Attempting to driver detach volume 9765396d-ef92-4472-b087-0eaab5cc64b8 from mountpoint /dev/vdb
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Attempting to detach device vdb from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:47:01 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:01 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:47:01 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:47:01 user nova-compute[74261]:   <serial>9765396d-ef92-4472-b087-0eaab5cc64b8</serial>
Oct 17 11:47:01 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 11:47:01 user nova-compute[74261]: </disk>
Oct 17 11:47:01 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:01 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully detached device vdb from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the persistent domain config.
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:47:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:47:01 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:01 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:47:01 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:47:01 user nova-compute[74261]:   <serial>9765396d-ef92-4472-b087-0eaab5cc64b8</serial>
Oct 17 11:47:01 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 11:47:01 user nova-compute[74261]: </disk>
Oct 17 11:47:01 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] volume_snapshot_create: create_info: {'snapshot_id': 'c3b54a66-e0f7-4ae2-acb7-a710eb548296', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74261) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] snap xml: <domainsnapshot>
Oct 17 11:47:02 user nova-compute[74261]:   <disks>
Oct 17 11:47:02 user nova-compute[74261]:     <disk name="/dev/sdf" snapshot="external" type="file">
Oct 17 11:47:02 user nova-compute[74261]:       <source file="/dev/new_file"/>
Oct 17 11:47:02 user nova-compute[74261]:     </disk>
Oct 17 11:47:02 user nova-compute[74261]:     <disk name="vda" snapshot="no"/>
Oct 17 11:47:02 user nova-compute[74261]:   </disks>
Oct 17 11:47:02 user nova-compute[74261]: </domainsnapshot>
Oct 17 11:47:02 user nova-compute[74261]:  {{(pid=74261) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] Lazy-loading 'system_metadata' on Instance uuid ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     rv = execute(f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     six.reraise(c, e, tb)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     raise value
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     rv = meth(*args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     self._volume_snapshot_create(context, instance, guest,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     rv = execute(f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     six.reraise(c, e, tb)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     raise value
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     rv = meth(*args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] 
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ec16b43e-fe23-4a73-a32b-9bb2297d5b91 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] volume_snapshot_delete: delete_info: {'volume_id': '74446115-2d56-49e8-ba4a-bd15e12361df'} {{(pid=74261) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [None req-ec16b43e-fe23-4a73-a32b-9bb2297d5b91 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825]     if delete_info['type'] != 'qcow2':
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] KeyError: 'type'
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] 
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c3b54a66-e0f7-4ae2-acb7-a710eb548296 could not be found.
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise value
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c3b54a66-e0f7-4ae2-acb7-a710eb548296 could not be found. (HTTP 404) (Request-ID: req-0cd2496d-ac98-4781-aa82-c7dcec6d2b54)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c3b54a66-e0f7-4ae2-acb7-a710eb548296 could not be found.
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server [None req-9bc4deaa-76ed-46c6-952e-76fe391cf0d4 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise value
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver [None req-ec16b43e-fe23-4a73-a32b-9bb2297d5b91 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-689d839a-446d-449d-a4eb-4f4d51caa211)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 17 11:47:02 user nova-compute[74261]: ERROR nova.virt.libvirt.driver 
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server [None req-ec16b43e-fe23-4a73-a32b-9bb2297d5b91 tempest-VolumesAssistedSnapshotsTest-1048509641 tempest-VolumesAssistedSnapshotsTest-1048509641-project] Exception during message handling: KeyError: 'type'
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 17 11:47:02 user nova-compute[74261]: ERROR oslo_messaging.rpc.server 
Oct 17 11:47:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:02 user nova-compute[74261]: INFO nova.compute.manager [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Detaching volume 74446115-2d56-49e8-ba4a-bd15e12361df
Oct 17 11:47:02 user nova-compute[74261]: INFO nova.virt.block_device [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Attempting to driver detach volume 74446115-2d56-49e8-ba4a-bd15e12361df from mountpoint /dev/vdb
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Attempting to detach device vdb from instance ea0ea436-4137-4c76-b12b-9d68f8646825 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] detach device xml: <disk type="block" device="disk">
Oct 17 11:47:02 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:02 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 11:47:02 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:47:02 user nova-compute[74261]:   <serial>74446115-2d56-49e8-ba4a-bd15e12361df</serial>
Oct 17 11:47:02 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:47:02 user nova-compute[74261]: </disk>
Oct 17 11:47:02 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Successfully detached device vdb from instance ea0ea436-4137-4c76-b12b-9d68f8646825 from the persistent domain config.
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea0ea436-4137-4c76-b12b-9d68f8646825 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:47:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] detach device xml: <disk type="block" device="disk">
Oct 17 11:47:02 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:02 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 11:47:02 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:47:02 user nova-compute[74261]:   <serial>74446115-2d56-49e8-ba4a-bd15e12361df</serial>
Oct 17 11:47:02 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:47:02 user nova-compute[74261]: </disk>
Oct 17 11:47:02 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:47:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:47:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:47:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:47:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Updating instance_info_cache with network_info: [{"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f75b961a-6dc8-496f-b5e0-4c8967cc991d" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:47:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.518535614013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance bfccfe8a-4414-44b0-9e94-12b6f7003406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d0bc8ec6-6f50-4013-a360-71c64069ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance ea0ea436-4137-4c76-b12b-9d68f8646825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance bdf1a49d-31bc-4d33-90cc-1837754cfcee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:47:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ukyMszKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:15 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:15 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:15 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22d153-f1e6-40dd-9313-61c9cec63e7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:47:15 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f930b7f-4d72-42bb-b81d-3e9823b69adc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c] added
Oct 17 11:47:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde899cc-28b4-45d3-a3cb-0c9974d7ed61]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[528e69e5-7cc5-487f-8b84-bab2a2df8b48]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ukyMszKv {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ukyMszKv" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[983ed716-1005-4d5c-b8b2-22204fa11d7f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ukyMszKv'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc966c-fbe7-4826-aa5a-fe78669b7fce]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc4924-0d54-4c61-bd1f-e94c9784a939]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9bc903-31fa-4464-b174-5702a70ee7c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260]
Oct 17 11:47:15 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f762a5c-9107-4c1f-bad3-9ad6908e861e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f286a-9333-476e-94e8-4dd51c017269]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:15 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593d4d0-9d16-4e28-8b38-ae0f7345cd25]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:47:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ukyMszKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:47:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26436623534326133', 'path': '/dev/sdg'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436623534326133', 'path': '/dev/sdg'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:47:16 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lazy-loading 'flavor' on Instance uuid 30bf8e80-b31c-44b5-b98e-d754cb3eff8b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:47:16 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:16 user nova-compute[74261]:   <source dev="/dev/sdg"/>
Oct 17 11:47:16 user nova-compute[74261]:   <target dev="sdc" bus="scsi"/>
Oct 17 11:47:16 user nova-compute[74261]:   <serial>771edd3b-dd80-43ad-94bb-0d2f7c56740c</serial>
Oct 17 11:47:16 user nova-compute[74261]:   <address type="drive" controller="0" unit="2"/>
Oct 17 11:47:16 user nova-compute[74261]: </disk>
Oct 17 11:47:16 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No BDM found with device name sda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] No VIF found with MAC fa:16:3e:d6:c7:e9, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2824c92-31c8-4d8c-be66-5c0c7e84be0f tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.808s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:47:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:18 user nova-compute[74261]: INFO nova.compute.manager [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Detaching volume 771edd3b-dd80-43ad-94bb-0d2f7c56740c
Oct 17 11:47:18 user nova-compute[74261]: INFO nova.virt.block_device [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Attempting to driver detach volume 771edd3b-dd80-43ad-94bb-0d2f7c56740c from mountpoint /dev/sdc
Oct 17 11:47:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Attempting to detach device sdc from instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:47:18 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:18 user nova-compute[74261]:   <source dev="/dev/sdg"/>
Oct 17 11:47:18 user nova-compute[74261]:   <target dev="sdc" bus="scsi"/>
Oct 17 11:47:18 user nova-compute[74261]:   <serial>771edd3b-dd80-43ad-94bb-0d2f7c56740c</serial>
Oct 17 11:47:18 user nova-compute[74261]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 17 11:47:18 user nova-compute[74261]: </disk>
Oct 17 11:47:18 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Successfully detached device sdc from instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b from the persistent domain config.
Oct 17 11:47:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:47:18 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:47:18 user nova-compute[74261]:   <source dev="/dev/sdg"/>
Oct 17 11:47:18 user nova-compute[74261]:   <target dev="sdc" bus="scsi"/>
Oct 17 11:47:18 user nova-compute[74261]:   <serial>771edd3b-dd80-43ad-94bb-0d2f7c56740c</serial>
Oct 17 11:47:18 user nova-compute[74261]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 17 11:47:18 user nova-compute[74261]: </disk>
Oct 17 11:47:18 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 is timed out.
Oct 17 11:47:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Successfully detached device vdb from instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 from the live domain config.
Oct 17 11:47:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaAdfESs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:18 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304d5ba-7442-4f85-a7b0-02ae8f882c4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:47:18 user nova-compute[74261]: No targets found.
Oct 17 11:47:18 user nova-compute[74261]: iSNS:
Oct 17 11:47:18 user nova-compute[74261]: No targets found.
Oct 17 11:47:18 user nova-compute[74261]: STATIC:
Oct 17 11:47:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df
Oct 17 11:47:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:47:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0
Oct 17 11:47:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c
Oct 17 11:47:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:47:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8
Oct 17 11:47:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:18 user nova-compute[74261]: FIRMWARE:
Oct 17 11:47:18 user nova-compute[74261]: No targets found.
Oct 17 11:47:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:47:18 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:47:18 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d70807-c005-46c1-a156-a831df60da1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1dc914-6713-4a12-a09a-2eaa15ec3bf9]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:18 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b242bf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5d25b-84fe-4f14-9ad8-f6b012693dc2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff8204-7a82-4a6c-ba44-b6cd79e9c4b6]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977bd68-0c0d-45c8-933b-f363ec01932b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe4848-a424-4dff-9157-ad9ad517d4a0]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:47:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32c1e7-c329-418b-ba5d-adcb8bdcf4f4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b63cb1d-407f-45a0-99f4-a39a7a3e6e0c]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260]
Oct 17 11:47:19 user nova-compute[74261]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493be656-2e73-4d3b-8acc-9080ff657be0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2dca33-0e9b-47e2-956f-17d5a6f80fe0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] <== disconnect_volume: return (319ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG nova.objects.instance [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'flavor' on Instance uuid 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-079b689f-1688-476b-9fac-649c7868a4ae tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.536s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsaiVrKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f', 'attached_at': '', 'detached_at': '', 'volume_id': '581268bb-0446-41d6-8235-9e49d911ff87', 'serial': '581268bb-0446-41d6-8235-9e49d911ff87'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f', 'attached_at': '', 'detached_at': '', 'volume_id': '731b9014-4c69-45bb-a259-af5e67f2a74c', 'serial'} {{(pid=74261) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsaiVrKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:22 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:22 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:22 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b8d97-5180-461f-96fd-cebfa1e0087a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:47:22 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfed0e-4d69-4630-a010-27f3ef3c5df7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87] added
Oct 17 11:47:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[904319f5-75ba-440c-9104-85738bc7377d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa06a08c-c077-4e33-8836-cdec05e19e59]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsaiVrKT {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsaiVrKT" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e8bdfe-1588-46c0-bb51-202a0f24685c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsaiVrKT'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b6fe1-e2f0-4d17-993d-dd2a368feb3e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e02d4-c691-4d98-850a-ade286d07365]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c861630-6871-496c-8686-d891af3bcddd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260]
Oct 17 11:47:22 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d7bdd-bc89-4762-a3c8-d701fffcefd6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1295d-651e-4574-a14e-69f567b28f19]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:22 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb0a06-8e88-436b-bf10-bc888156147b]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:47:22 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 is timed out.
Oct 17 11:47:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully detached device vdb from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the live domain config.
Oct 17 11:47:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXPTAhRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:22 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:23 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea0ea436-4137-4c76-b12b-9d68f8646825 is timed out.
Oct 17 11:47:23 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Successfully detached device vdb from instance ea0ea436-4137-4c76-b12b-9d68f8646825 from the live domain config.
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsaiVrKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23135303163376166', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135303163376166', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.908s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDEygdZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:23 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lazy-loading 'flavor' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[97932ca0-214b-45f6-96d5-61e1c2c29203]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:47:23 user nova-compute[74261]: No targets found.
Oct 17 11:47:23 user nova-compute[74261]: iSNS:
Oct 17 11:47:23 user nova-compute[74261]: No targets found.
Oct 17 11:47:23 user nova-compute[74261]: STATIC:
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: FIRMWARE:
Oct 17 11:47:23 user nova-compute[74261]: No targets found.
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:47:23 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:47:23 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b7f73-4582-49e9-9a64-64521a4f7035]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6c5e8-ff87-4b21-8486-b9b49c151ed7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24114e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[15723fa1-89f9-4fa6-8698-e993fa00641f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafe75e5-9ccc-47f7-bc8e-dcec9a5aeaf1]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883ffec-7b64-4587-8f42-a09705b66b28]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e72927-ed6c-46a6-b47b-394fefc564d3]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e4d15c-af8b-4158-aac8-67d83d54232a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691b332-3607-4b9b-8af6-180fba6be3f6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260]
Oct 17 11:47:23 user nova-compute[74261]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9765396d-ef92-4472-b087-0eaab5cc64b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b3d3f0-9cf3-4577-9e04-6e8c59efe7d5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] <== disconnect_volume: return (1235ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.329s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b62d01-c03b-4dc5-99b2-75020945ccb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:47:23 user nova-compute[74261]: No targets found.
Oct 17 11:47:23 user nova-compute[74261]: iSNS:
Oct 17 11:47:23 user nova-compute[74261]: No targets found.
Oct 17 11:47:23 user nova-compute[74261]: STATIC:
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:47:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:23 user nova-compute[74261]: FIRMWARE:
Oct 17 11:47:23 user nova-compute[74261]: No targets found.
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:47:23 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:47:23 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2054a16f-0a17-4f20-a1ff-9f73475e991f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[288da35b-ee88-4177-aa82-e809fd65111b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:23 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b242be4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df'): ({'sdf'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Removing single pathed devices sdf {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad747b80-c7f1-4f24-a67c-60cefabbbc22]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[694928c3-ceb7-47ca-b91b-25d05c20ffd2]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Flushing IO for device /dev/sdf {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e324e8-ad5c-4a2a-be7a-d054bf7f021f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[450f24ab-a0fb-4b17-91b7-d789c22cef16]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b80f10-6995-4a8f-ac52-0014acaa84a2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[68020342-6bc6-4968-ab9c-c9d63b37f47c]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260]
Oct 17 11:47:24 user nova-compute[74261]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:24 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74446115-2d56-49e8-ba4a-bd15e12361df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb6b7d-2be7-4c29-8d80-f51b10d6d21c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] <== disconnect_volume: return (688ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 118489088 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 270532608 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 424673280 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:25 user nova-compute[74261]: DEBUG nova.objects.instance [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lazy-loading 'flavor' on Instance uuid ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7ae1a16f-dd64-47f4-973f-55f0d2df56a6 tempest-VolumesAssistedSnapshotsTest-1083178034 tempest-VolumesAssistedSnapshotsTest-1083178034-project-admin] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.671s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 591396864 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 731906048 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 889192448 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 1010827264 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:27 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:27 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[25853c3b-5f35-4a95-88ad-b2010c8bed74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:47:28 user nova-compute[74261]: No targets found.
Oct 17 11:47:28 user nova-compute[74261]: iSNS:
Oct 17 11:47:28 user nova-compute[74261]: No targets found.
Oct 17 11:47:28 user nova-compute[74261]: STATIC:
Oct 17 11:47:28 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87
Oct 17 11:47:28 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:28 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:28 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:47:28 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:28 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:28 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c
Oct 17 11:47:28 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:28 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:28 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:47:28 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:28 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:28 user nova-compute[74261]: FIRMWARE:
Oct 17 11:47:28 user nova-compute[74261]: No targets found.
Oct 17 11:47:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:47:28 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:47:28 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ded9a-4196-45fd-a94a-f26b9ed81a1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3b46a-853e-4939-9e11-c8c13c70947c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:28 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:28 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:28 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:28 user nova-compute[74261]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:28 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:28 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24115900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c'): ({'sde'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Removing single pathed devices sde {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d125af-8ef0-4ecc-a108-454d987dfd5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b81506-07f8-48ff-9d05-65bd8c071b4f]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Flushing IO for device /dev/sde {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[961fa9c8-af65-410d-852e-1b143e0a3cd9]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb955b-3202-4e56-b641-dda71783b0f3]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5de2b5-8116-4ccf-bec3-a9f1e6063836]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a2554-7e07-4e7c-b047-6545d7f234ba]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]
Oct 17 11:47:28 user nova-compute[74261]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec75b8b0-a1a2-4314-9cdd-0f383eb70258]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] <== disconnect_volume: return (300ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsaiVrKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f', 'attached_at': '', 'detached_at': '', 'volume_id': '581268bb-0446-41d6-8235-9e49d911ff87', 'serial'} {{(pid=74261) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 17 11:47:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] swap_volume: removing Cinder connection for volume 731b9014-4c69-45bb-a259-af5e67f2a74c {{(pid=74261) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 17 11:47:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] swap_volume: Updating volume 731b9014-4c69-45bb-a259-af5e67f2a74c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "FsaiVrKT", "auth_password": "tmsFHWXeJ9TlQy", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "581268bb-0446-41d6-8235-9e49d911ff87"}, "status": "reserved", "instance": "d0bc8ec6-6f50-4013-a360-71c64069ed2f", "attached_at": "", "detached_at": "", "volume_id": "581268bb-0446-41d6-8235-9e49d911ff87", "serial": "581268bb-0446-41d6-8235-9e49d911ff87"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '581268bb-0446-41d6-8235-9e49d911ff87', 'no_device': None, 'attachment_id': '45b09c23-c9c1-41ed-abf9-e15c556c73c8'} {{(pid=74261) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 17 11:47:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8da64b10-2d25-445b-9023-4c3268037f76 tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.278s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG os_brick.utils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d94fbc8-1902-43c1-abc5-fe5d56da888a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6358ef25-f3a5-4a1a-ba60-ad3dbea9f682]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bee190a-cae6-4768-8fc1-7f367aeb43eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[edefb645-9beb-4564-9524-35c566b632b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:47:30 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:47:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7eeda-043a-40ff-b602-745f66d44360]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:47:30 user nova-compute[74261]: DEBUG os_brick.utils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:30 user nova-compute[74261]: INFO nova.compute.manager [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Swapping volume 581268bb-0446-41d6-8235-9e49d911ff87 for 731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:47:32 user nova-compute[74261]: DEBUG nova.objects.instance [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'flavor' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4b812ae8-ce1c-4665-8306-3dfdb88ccb7f tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.853s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "interface-bfccfe8a-4414-44b0-9e94-12b6f7003406-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "interface-bfccfe8a-4414-44b0-9e94-12b6f7003406-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.objects.instance [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'flavor' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface> {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface> {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Attempting to detach device tap9c92b46a-db from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] detach device xml: <interface type="ethernet">
Oct 17 11:47:33 user nova-compute[74261]:   <mac address="fa:16:3e:6d:b0:9c"/>
Oct 17 11:47:33 user nova-compute[74261]:   <model type="virtio"/>
Oct 17 11:47:33 user nova-compute[74261]:   <mtu size="1442"/>
Oct 17 11:47:33 user nova-compute[74261]:   <target dev="tap9c92b46a-db"/>
Oct 17 11:47:33 user nova-compute[74261]: </interface>
Oct 17 11:47:33 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface> {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 17 11:47:33 user nova-compute[74261]:   <name>instance-00000009</name>
Oct 17 11:47:33 user nova-compute[74261]:   <uuid>bfccfe8a-4414-44b0-9e94-12b6f7003406</uuid>
Oct 17 11:47:33 user nova-compute[74261]:   <metadata>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:33 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:47:33 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:47:33 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:46:30</nova:creationTime>
Oct 17 11:47:33 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:47:33 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:33 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:47:33 user nova-compute[74261]:   <nova:owner>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:47:33 user nova-compute[74261]:   </nova:owner>
Oct 17 11:47:33 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:33 user nova-compute[74261]:   <nova:ports>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:47:33 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:47:33 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:33 user nova-compute[74261]:     <nova:port uuid="9c92b46a-dbfa-4d44-89c8-48444dbc4d9b">
Oct 17 11:47:33 user nova-compute[74261]:       <nova:ip type="fixed" address="10.10.10.137" ipVersion="4"/>
Oct 17 11:47:33 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:33 user nova-compute[74261]:   </nova:ports>
Oct 17 11:47:33 user nova-compute[74261]: </nova:instance>
Oct 17 11:47:33 user nova-compute[74261]:   </metadata>
Oct 17 11:47:33 user nova-compute[74261]:   <memory unit='KiB'>524288</memory>
Oct 17 11:47:33 user nova-compute[74261]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 17 11:47:33 user nova-compute[74261]:   <vcpu placement='static'>1</vcpu>
Oct 17 11:47:33 user nova-compute[74261]:   <resource>
Oct 17 11:47:33 user nova-compute[74261]:     <partition>/machine</partition>
Oct 17 11:47:33 user nova-compute[74261]:   </resource>
Oct 17 11:47:33 user nova-compute[74261]:   <sysinfo type='smbios'>
Oct 17 11:47:33 user nova-compute[74261]:     <system>
Oct 17 11:47:33 user nova-compute[74261]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 17 11:47:33 user nova-compute[74261]:       <entry name='product'>OpenStack Nova</entry>
Oct 17 11:47:33 user nova-compute[74261]:       <entry name='version'>0.0.0</entry>
Oct 17 11:47:33 user nova-compute[74261]:       <entry name='serial'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:33 user nova-compute[74261]:       <entry name='uuid'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:33 user nova-compute[74261]:       <entry name='family'>Virtual Machine</entry>
Oct 17 11:47:33 user nova-compute[74261]:     </system>
Oct 17 11:47:33 user nova-compute[74261]:   </sysinfo>
Oct 17 11:47:33 user nova-compute[74261]:   <os>
Oct 17 11:47:33 user nova-compute[74261]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 17 11:47:33 user nova-compute[74261]:     <boot dev='hd'/>
Oct 17 11:47:33 user nova-compute[74261]:     <smbios mode='sysinfo'/>
Oct 17 11:47:33 user nova-compute[74261]:   </os>
Oct 17 11:47:33 user nova-compute[74261]:   <features>
Oct 17 11:47:33 user nova-compute[74261]:     <acpi/>
Oct 17 11:47:33 user nova-compute[74261]:     <apic/>
Oct 17 11:47:33 user nova-compute[74261]:     <vmcoreinfo state='on'/>
Oct 17 11:47:33 user nova-compute[74261]:   </features>
Oct 17 11:47:33 user nova-compute[74261]:   <cpu mode='custom' match='exact' check='full'>
Oct 17 11:47:33 user nova-compute[74261]:     <model fallback='forbid'>Nehalem</model>
Oct 17 11:47:33 user nova-compute[74261]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 17 11:47:33 user nova-compute[74261]:     <feature policy='require' name='vme'/>
Oct 17 11:47:33 user nova-compute[74261]:     <feature policy='require' name='x2apic'/>
Oct 17 11:47:33 user nova-compute[74261]:     <feature policy='require' name='hypervisor'/>
Oct 17 11:47:33 user nova-compute[74261]:   </cpu>
Oct 17 11:47:33 user nova-compute[74261]:   <clock offset='utc'>
Oct 17 11:47:33 user nova-compute[74261]:     <timer name='pit' tickpolicy='delay'/>
Oct 17 11:47:33 user nova-compute[74261]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 17 11:47:33 user nova-compute[74261]:     <timer name='hpet' present='no'/>
Oct 17 11:47:33 user nova-compute[74261]:   </clock>
Oct 17 11:47:33 user nova-compute[74261]:   <on_poweroff>destroy</on_poweroff>
Oct 17 11:47:33 user nova-compute[74261]:   <on_reboot>restart</on_reboot>
Oct 17 11:47:33 user nova-compute[74261]:   <on_crash>destroy</on_crash>
Oct 17 11:47:33 user nova-compute[74261]:   <devices>
Oct 17 11:47:33 user nova-compute[74261]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 17 11:47:33 user nova-compute[74261]:     <disk type='file' device='disk'>
Oct 17 11:47:33 user nova-compute[74261]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 17 11:47:33 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk' index='2'/>
Oct 17 11:47:33 user nova-compute[74261]:       <backingStore type='file' index='3'>
Oct 17 11:47:33 user nova-compute[74261]:         <format type='raw'/>
Oct 17 11:47:33 user nova-compute[74261]:         <source file='/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c'/>
Oct 17 11:47:33 user nova-compute[74261]:         <backingStore/>
Oct 17 11:47:33 user nova-compute[74261]:       </backingStore>
Oct 17 11:47:33 user nova-compute[74261]:       <target dev='vda' bus='virtio'/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='virtio-disk0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </disk>
Oct 17 11:47:33 user nova-compute[74261]:     <disk type='file' device='cdrom'>
Oct 17 11:47:33 user nova-compute[74261]:       <driver name='qemu' type='raw' cache='none'/>
Oct 17 11:47:33 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config' index='1'/>
Oct 17 11:47:33 user nova-compute[74261]:       <backingStore/>
Oct 17 11:47:33 user nova-compute[74261]:       <target dev='hda' bus='ide'/>
Oct 17 11:47:33 user nova-compute[74261]:       <readonly/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='ide0-0-0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </disk>
Oct 17 11:47:33 user nova-compute[74261]:     <controller type='usb' index='0' model='none'>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='usb'/>
Oct 17 11:47:33 user nova-compute[74261]:     </controller>
Oct 17 11:47:33 user nova-compute[74261]:     <controller type='pci' index='0' model='pci-root'>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='pci.0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </controller>
Oct 17 11:47:33 user nova-compute[74261]:     <controller type='ide' index='0'>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='ide'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 17 11:47:33 user nova-compute[74261]:     </controller>
Oct 17 11:47:33 user nova-compute[74261]:     <interface type='ethernet'>
Oct 17 11:47:33 user nova-compute[74261]:       <mac address='fa:16:3e:44:d7:13'/>
Oct 17 11:47:33 user nova-compute[74261]:       <target dev='tapc52b809b-bc'/>
Oct 17 11:47:33 user nova-compute[74261]:       <model type='virtio'/>
Oct 17 11:47:33 user nova-compute[74261]:       <mtu size='1442'/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='net0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </interface>
Oct 17 11:47:33 user nova-compute[74261]:     <interface type='ethernet'>
Oct 17 11:47:33 user nova-compute[74261]:       <mac address='fa:16:3e:6d:b0:9c'/>
Oct 17 11:47:33 user nova-compute[74261]:       <target dev='tap9c92b46a-db'/>
Oct 17 11:47:33 user nova-compute[74261]:       <model type='virtio'/>
Oct 17 11:47:33 user nova-compute[74261]:       <mtu size='1442'/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='net1'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </interface>
Oct 17 11:47:33 user nova-compute[74261]:     <serial type='pty'>
Oct 17 11:47:33 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:33 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:33 user nova-compute[74261]:       <target type='isa-serial' port='0'>
Oct 17 11:47:33 user nova-compute[74261]:         <model name='isa-serial'/>
Oct 17 11:47:33 user nova-compute[74261]:       </target>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </serial>
Oct 17 11:47:33 user nova-compute[74261]:     <console type='pty' tty='/dev/pts/8'>
Oct 17 11:47:33 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:33 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:33 user nova-compute[74261]:       <target type='serial' port='0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </console>
Oct 17 11:47:33 user nova-compute[74261]:     <input type='mouse' bus='ps2'>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='input0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </input>
Oct 17 11:47:33 user nova-compute[74261]:     <input type='keyboard' bus='ps2'>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='input1'/>
Oct 17 11:47:33 user nova-compute[74261]:     </input>
Oct 17 11:47:33 user nova-compute[74261]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 17 11:47:33 user nova-compute[74261]:       <listen type='address' address='0.0.0.0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </graphics>
Oct 17 11:47:33 user nova-compute[74261]:     <audio id='1' type='none'/>
Oct 17 11:47:33 user nova-compute[74261]:     <video>
Oct 17 11:47:33 user nova-compute[74261]:       <model type='virtio' heads='1' primary='yes'/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='video0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </video>
Oct 17 11:47:33 user nova-compute[74261]:     <memballoon model='virtio'>
Oct 17 11:47:33 user nova-compute[74261]:       <stats period='10'/>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='balloon0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </memballoon>
Oct 17 11:47:33 user nova-compute[74261]:     <rng model='virtio'>
Oct 17 11:47:33 user nova-compute[74261]:       <backend model='random'>/dev/urandom</backend>
Oct 17 11:47:33 user nova-compute[74261]:       <alias name='rng0'/>
Oct 17 11:47:33 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 17 11:47:33 user nova-compute[74261]:     </rng>
Oct 17 11:47:33 user nova-compute[74261]:   </devices>
Oct 17 11:47:33 user nova-compute[74261]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 17 11:47:33 user nova-compute[74261]:     <label>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</label>
Oct 17 11:47:33 user nova-compute[74261]:     <imagelabel>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</imagelabel>
Oct 17 11:47:33 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:33 user nova-compute[74261]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 17 11:47:33 user nova-compute[74261]:     <label>+64055:+108</label>
Oct 17 11:47:33 user nova-compute[74261]:     <imagelabel>+64055:+108</imagelabel>
Oct 17 11:47:33 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:33 user nova-compute[74261]: </domain>
Oct 17 11:47:33 user nova-compute[74261]:  {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 17 11:47:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully detached device tap9c92b46a-db from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the persistent domain config.
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] (1/8): Attempting to detach device tap9c92b46a-db with device alias net1 from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] detach device xml: <interface type="ethernet">
Oct 17 11:47:33 user nova-compute[74261]:   <mac address="fa:16:3e:6d:b0:9c"/>
Oct 17 11:47:33 user nova-compute[74261]:   <model type="virtio"/>
Oct 17 11:47:33 user nova-compute[74261]:   <mtu size="1442"/>
Oct 17 11:47:33 user nova-compute[74261]:   <target dev="tap9c92b46a-db"/>
Oct 17 11:47:33 user nova-compute[74261]: </interface>
Oct 17 11:47:33 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Start waiting for the detach event from libvirt for device tap9c92b46a-db with device alias net1 for instance bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-39a88de2-2064-4ab3-89de-ef3d2199de4f req-eccb8092-a094-4723-b7a3-54a68e4c5f38 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-unplugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39a88de2-2064-4ab3-89de-ef3d2199de4f req-eccb8092-a094-4723-b7a3-54a68e4c5f38 service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39a88de2-2064-4ab3-89de-ef3d2199de4f req-eccb8092-a094-4723-b7a3-54a68e4c5f38 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39a88de2-2064-4ab3-89de-ef3d2199de4f req-eccb8092-a094-4723-b7a3-54a68e4c5f38 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-39a88de2-2064-4ab3-89de-ef3d2199de4f req-eccb8092-a094-4723-b7a3-54a68e4c5f38 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-unplugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:33 user nova-compute[74261]: WARNING nova.compute.manager [req-39a88de2-2064-4ab3-89de-ef3d2199de4f req-eccb8092-a094-4723-b7a3-54a68e4c5f38 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-unplugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b for instance with vm_state active and task_state None.
Oct 17 11:47:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-7b5e7ed9-c3b4-428c-9cf6-40f515f142ea req-53a32924-40e1-4852-ac8c-a3dab7cdd3fa service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7b5e7ed9-c3b4-428c-9cf6-40f515f142ea req-53a32924-40e1-4852-ac8c-a3dab7cdd3fa service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7b5e7ed9-c3b4-428c-9cf6-40f515f142ea req-53a32924-40e1-4852-ac8c-a3dab7cdd3fa service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7b5e7ed9-c3b4-428c-9cf6-40f515f142ea req-53a32924-40e1-4852-ac8c-a3dab7cdd3fa service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-7b5e7ed9-c3b4-428c-9cf6-40f515f142ea req-53a32924-40e1-4852-ac8c-a3dab7cdd3fa service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:35 user nova-compute[74261]: WARNING nova.compute.manager [req-7b5e7ed9-c3b4-428c-9cf6-40f515f142ea req-53a32924-40e1-4852-ac8c-a3dab7cdd3fa service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-plugged-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b for instance with vm_state active and task_state None.
Oct 17 11:47:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b is timed out.
Oct 17 11:47:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Successfully detached device sdc from instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b from the live domain config.
Oct 17 11:47:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:47:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ukyMszKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:38 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ca5f6-ffca-4d70-add1-a89b6f16e3d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:47:39 user nova-compute[74261]: No targets found.
Oct 17 11:47:39 user nova-compute[74261]: iSNS:
Oct 17 11:47:39 user nova-compute[74261]: No targets found.
Oct 17 11:47:39 user nova-compute[74261]: STATIC:
Oct 17 11:47:39 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87
Oct 17 11:47:39 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:39 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:39 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c
Oct 17 11:47:39 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:39 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:39 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:47:39 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:39 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:39 user nova-compute[74261]: FIRMWARE:
Oct 17 11:47:39 user nova-compute[74261]: No targets found.
Oct 17 11:47:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:47:39 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:47:39 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d9db8-7ce0-4542-8444-a8a73149f8b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ff8eed-c41f-41e6-a6c1-94323a0af55c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:39 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:39 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:39 user nova-compute[74261]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c (non-flash)
Oct 17 11:47:39 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b241af880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c'): ({'sdg'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Removing single pathed devices sdg {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb336983-b9be-4bb6-a5f9-fe7483151a34]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb96d3-5158-44cd-831a-bd643ba42ec6]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Flushing IO for device /dev/sdg {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa40f4b-8a7f-46d9-bc18-858e72b331fe]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e30620-73a2-40b4-a9cc-e8785c3e8975]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] SCSI volumes sdg have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e4a68-f3dd-4f8d-8f7a-ca187f3966aa]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf96902-93ec-454e-b580-0de3b20d8f5a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260]
Oct 17 11:47:39 user nova-compute[74261]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771edd3b-dd80-43ad-94bb-0d2f7c56740c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad7247-92e3-4868-9084-b1d71b6e09e3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] <== disconnect_volume: return (318ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:47:40 user nova-compute[74261]: DEBUG nova.objects.instance [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lazy-loading 'flavor' on Instance uuid 30bf8e80-b31c-44b5-b98e-d754cb3eff8b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dc0539a2-aa86-4cef-a273-f63df0c0dcc5 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.768s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:41 user nova-compute[74261]: INFO nova.compute.manager [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Terminating instance
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-44521b07-5526-44fa-a2d3-adeff987d59c req-9d41679e-1cad-49b6-8729-e702dd49fa74 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-vif-unplugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-44521b07-5526-44fa-a2d3-adeff987d59c req-9d41679e-1cad-49b6-8729-e702dd49fa74 service nova] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-44521b07-5526-44fa-a2d3-adeff987d59c req-9d41679e-1cad-49b6-8729-e702dd49fa74 service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-44521b07-5526-44fa-a2d3-adeff987d59c req-9d41679e-1cad-49b6-8729-e702dd49fa74 service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-44521b07-5526-44fa-a2d3-adeff987d59c req-9d41679e-1cad-49b6-8729-e702dd49fa74 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] No waiting events found dispatching network-vif-unplugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-44521b07-5526-44fa-a2d3-adeff987d59c req-9d41679e-1cad-49b6-8729-e702dd49fa74 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-vif-unplugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:47:41 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Instance destroyed successfully.
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lazy-loading 'resources' on Instance uuid 30bf8e80-b31c-44b5-b98e-d754cb3eff8b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1201298073',display_name='tempest-AttachSCSIVolumeTestJSON-server-1201298073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1201298073',id=8,image_ref='54c348de-259f-4849-bcc3-a946848dbbd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5k7FTq6MvyWlSiwgjfEIo4msCmzxwJ697ehjXFZwrmF5mOg3CV5rhe9Qr8NabPn/YE3l0ZoMGPeg1Q6/HorluRKQuhMxKPru3xeXnTJUfuQ2WHXTgf42skZViGl3tuCg==',key_name='tempest-keypair-1942216204',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d91912c7347042c99d8b8d31e5cc62cc',ramdisk_id='',reservation_id='r-nrlagpjh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54c348de-259f-4849-bcc3-a946848dbbd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-208244615',owner_user_name='tempest-AttachSCSIVolumeTestJSON-208244615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67aab23b500d41b89051dce4887d9137',uuid=30bf8e80-b31c-44b5-b98e-d754cb3eff8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Converting VIF {"id": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "address": "fa:16:3e:d6:c7:e9", "network": {"id": "1493d751-05be-4474-963d-3088242d6a08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-216560357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91912c7347042c99d8b8d31e5cc62cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa28e8b-9d", "ovs_interfaceid": "cfa28e8b-9db3-4a3f-9e38-535542e7b371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG os_vif [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfa28e8b-9d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0a8074f-184d-4ae3-a67c-2ea834017155) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:42 user nova-compute[74261]: INFO os_vif [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c7:e9,bridge_name='br-int',has_traffic_filtering=True,id=cfa28e8b-9db3-4a3f-9e38-535542e7b371,network=Network(1493d751-05be-4474-963d-3088242d6a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa28e8b-9d')
Oct 17 11:47:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Deleting instance files /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b_del
Oct 17 11:47:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Deletion of /opt/stack/data/nova/instances/30bf8e80-b31c-44b5-b98e-d754cb3eff8b_del complete
Oct 17 11:47:42 user nova-compute[74261]: INFO nova.compute.manager [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 17 11:47:42 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:47:42 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:47:42 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:43 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Took 1.16 seconds to deallocate network for instance.
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-960db84f-7104-47aa-93f0-78314104b580 req-a3c29d45-e513-4f28-bb8e-309f95500ba0 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-vif-deleted-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:43 user nova-compute[74261]: INFO nova.compute.manager [req-960db84f-7104-47aa-93f0-78314104b580 req-a3c29d45-e513-4f28-bb8e-309f95500ba0 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Neutron deleted interface cfa28e8b-9db3-4a3f-9e38-535542e7b371; detaching it from the instance and deleting it from the info cache
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-960db84f-7104-47aa-93f0-78314104b580 req-a3c29d45-e513-4f28-bb8e-309f95500ba0 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-960db84f-7104-47aa-93f0-78314104b580 req-a3c29d45-e513-4f28-bb8e-309f95500ba0 service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Detach interface failed, port_id=cfa28e8b-9db3-4a3f-9e38-535542e7b371, reason: Instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-c2bf03d7-823e-45b7-97ff-c6b418e14b20 req-e7a43d4e-ad18-44e7-9a45-75435e49494f service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received event network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c2bf03d7-823e-45b7-97ff-c6b418e14b20 req-e7a43d4e-ad18-44e7-9a45-75435e49494f service nova] Acquiring lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c2bf03d7-823e-45b7-97ff-c6b418e14b20 req-e7a43d4e-ad18-44e7-9a45-75435e49494f service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c2bf03d7-823e-45b7-97ff-c6b418e14b20 req-e7a43d4e-ad18-44e7-9a45-75435e49494f service nova] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-c2bf03d7-823e-45b7-97ff-c6b418e14b20 req-e7a43d4e-ad18-44e7-9a45-75435e49494f service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] No waiting events found dispatching network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:43 user nova-compute[74261]: WARNING nova.compute.manager [req-c2bf03d7-823e-45b7-97ff-c6b418e14b20 req-e7a43d4e-ad18-44e7-9a45-75435e49494f service nova] [instance: 30bf8e80-b31c-44b5-b98e-d754cb3eff8b] Received unexpected event network-vif-plugged-cfa28e8b-9db3-4a3f-9e38-535542e7b371 for instance with vm_state deleted and task_state None.
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:43 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Deleted allocations for instance 30bf8e80-b31c-44b5-b98e-d754cb3eff8b
Oct 17 11:47:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c60b9b93-d0b6-477f-bf7b-994d772971b9 tempest-AttachSCSIVolumeTestJSON-208244615 tempest-AttachSCSIVolumeTestJSON-208244615-project-member] Lock "30bf8e80-b31c-44b5-b98e-d754cb3eff8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:45 user nova-compute[74261]: INFO nova.compute.manager [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Terminating instance
Oct 17 11:47:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-5bcd5775-7a9c-4c1c-a221-0be913189680 req-62478346-5552-4674-99b3-61c6894ce0ad service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-vif-unplugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5bcd5775-7a9c-4c1c-a221-0be913189680 req-62478346-5552-4674-99b3-61c6894ce0ad service nova] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5bcd5775-7a9c-4c1c-a221-0be913189680 req-62478346-5552-4674-99b3-61c6894ce0ad service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5bcd5775-7a9c-4c1c-a221-0be913189680 req-62478346-5552-4674-99b3-61c6894ce0ad service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-5bcd5775-7a9c-4c1c-a221-0be913189680 req-62478346-5552-4674-99b3-61c6894ce0ad service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] No waiting events found dispatching network-vif-unplugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-5bcd5775-7a9c-4c1c-a221-0be913189680 req-62478346-5552-4674-99b3-61c6894ce0ad service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-vif-unplugged-a7e5ec38-3701-473a-a517-bc04f0030180 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Instance destroyed successfully.
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lazy-loading 'resources' on Instance uuid bdf1a49d-31bc-4d33-90cc-1837754cfcee {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-857782247',display_name='tempest-ServersNegativeTestJSON-server-857782247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-857782247',id=12,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:46:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8bd718919439f8a804d2b74561f1d',ramdisk_id='',reservation_id='r-q0gifj99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1086864809',owner_user_name='tempest-ServersNegativeTestJSON-1086864809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:46:03Z,user_data=None,user_id='57dc5550d0fb4f0f8aaf2633b1ad6095',uuid=bdf1a49d-31bc-4d33-90cc-1837754cfcee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converting VIF {"id": "a7e5ec38-3701-473a-a517-bc04f0030180", "address": "fa:16:3e:89:7d:40", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e5ec38-37", "ovs_interfaceid": "a7e5ec38-3701-473a-a517-bc04f0030180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG os_vif [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7e5ec38-37, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229415dd-4193-4b64-ae4d-a363569e439f) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:46 user nova-compute[74261]: INFO os_vif [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=a7e5ec38-3701-473a-a517-bc04f0030180,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e5ec38-37')
Oct 17 11:47:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Deleting instance files /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee_del
Oct 17 11:47:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Deletion of /opt/stack/data/nova/instances/bdf1a49d-31bc-4d33-90cc-1837754cfcee_del complete
Oct 17 11:47:46 user nova-compute[74261]: INFO nova.compute.manager [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 17 11:47:46 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:47:46 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:47 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Took 0.52 seconds to deallocate network for instance.
Oct 17 11:47:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-3bb4fac3-76a8-4b0e-bafe-3b6971e3dc81 req-32693252-586c-4cd1-a2f4-108268f19fc9 service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-vif-deleted-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:47 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Deleted allocations for instance bdf1a49d-31bc-4d33-90cc-1837754cfcee
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bd5d9dd-9f29-47a2-86f7-677267ade9c7 tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:47:47 user nova-compute[74261]: INFO nova.compute.claims [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Claim successful on node user
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-b28db780-38c1-46d3-b459-a710193066ee req-a4a0d7c9-a6f5-4b09-ab75-041764004b2b service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received event network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b28db780-38c1-46d3-b459-a710193066ee req-a4a0d7c9-a6f5-4b09-ab75-041764004b2b service nova] Acquiring lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b28db780-38c1-46d3-b459-a710193066ee req-a4a0d7c9-a6f5-4b09-ab75-041764004b2b service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b28db780-38c1-46d3-b459-a710193066ee req-a4a0d7c9-a6f5-4b09-ab75-041764004b2b service nova] Lock "bdf1a49d-31bc-4d33-90cc-1837754cfcee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-b28db780-38c1-46d3-b459-a710193066ee req-a4a0d7c9-a6f5-4b09-ab75-041764004b2b service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] No waiting events found dispatching network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:48 user nova-compute[74261]: WARNING nova.compute.manager [req-b28db780-38c1-46d3-b459-a710193066ee req-a4a0d7c9-a6f5-4b09-ab75-041764004b2b service nova] [instance: bdf1a49d-31bc-4d33-90cc-1837754cfcee] Received unexpected event network-vif-plugged-a7e5ec38-3701-473a-a517-bc04f0030180 for instance with vm_state deleted and task_state None.
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f', 'attached_at': '', 'detached_at': '', 'volume_id': '731b9014-4c69-45bb-a259-af5e67f2a74c', 'serial': '731b9014-4c69-45bb-a259-af5e67f2a74c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsaiVrKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '581268bb-0446-41d6-8235-9e49d911ff87'}, 'status': 'reserved', 'instance': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f', 'attached_at': '', 'detached_at': '', 'volume_id': '581268bb-0446-41d6-8235-9e49d911ff87', 'serial'} {{(pid=74261) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:48 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:48 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:48 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4681bde-e694-4433-9d72-4b5c8cf6cbe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:47:48 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8e1c5-5b53-45e2-a753-8371a0e597a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c] added
Oct 17 11:47:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[37613c9a-9abd-4917-8576-0b30df17512b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb98b4-a9d9-427f-898f-610bdad6449c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOLbhCWF {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOLbhCWF" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b6a089-8a04-41dd-b400-0ce40261c2c7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOLbhCWF'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ed35b-0e6a-4a0b-899e-d77529e4056d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c17ff-8052-4435-a851-ab5929819534]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:48 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:48 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.policy [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ab08ea77d1c44588ce76ec801bfa11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf4a57fa9484c8c8fc774664775226e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f67f1-8a44-4c3c-bb56-bdf166ec87ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]
Oct 17 11:47:48 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5c1a00-c947-4682-a8f2-10703d57d04c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e3ab5-0527-480f-8014-e1726444d2b9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:48 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:48 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:48 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:48 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:47:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Creating image(s)
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "/opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "/opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "/opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c52eb2-6679-4ec8-9e4b-ecad75cf41dc]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:47:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.224s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk 1073741824" returned: 0 in 0.052s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Successfully created port: 3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Cannot resize image /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Ensure instance console log exists: /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23530623638383764', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530623638383764', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:47:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lazy-loading 'flavor' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Successfully updated port: 3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "refresh_cache-68fa8b56-a6bb-4201-b1b0-29d50408673e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquired lock "refresh_cache-68fa8b56-a6bb-4201-b1b0-29d50408673e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-changed-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Refreshing instance network info cache due to event network-changed-3efb487a-23f5-44f0-a34e-1145c39c2241. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] Acquiring lock "refresh_cache-68fa8b56-a6bb-4201-b1b0-29d50408673e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'flavor' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Updating instance_info_cache with network_info: [{"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Releasing lock "refresh_cache-68fa8b56-a6bb-4201-b1b0-29d50408673e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Instance network_info: |[{"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] Acquired lock "refresh_cache-68fa8b56-a6bb-4201-b1b0-29d50408673e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Refreshing network info cache for port 3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Start _get_guest_xml network_info=[{"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:47:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:47:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:47:50 user nova-compute[74261]: INFO nova.compute.claims [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Claim successful on node user
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-602880739',display_name='tempest-VolumesAdminNegativeTest-server-602880739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-602880739',id=13,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf4a57fa9484c8c8fc774664775226e',ramdisk_id='',reservation_id='r-02b9bbtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-593462057',owner_user_name='tempest-VolumesAdminNegativeTest-593462057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:47:49Z,user_data=None,user_id='3ab08ea77d1c44588ce76ec801bfa11e',uuid=68fa8b56-a6bb-4201-b1b0-29d50408673e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converting VIF {"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'pci_devices' on Instance uuid 68fa8b56-a6bb-4201-b1b0-29d50408673e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:47:50 user nova-compute[74261]:   <uuid>68fa8b56-a6bb-4201-b1b0-29d50408673e</uuid>
Oct 17 11:47:50 user nova-compute[74261]:   <name>instance-0000000d</name>
Oct 17 11:47:50 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:47:50 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:47:50 user nova-compute[74261]:   <metadata>
Oct 17 11:47:50 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:50 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:47:50 user nova-compute[74261]:       <nova:name>tempest-VolumesAdminNegativeTest-server-602880739</nova:name>
Oct 17 11:47:50 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:47:50</nova:creationTime>
Oct 17 11:47:50 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:47:50 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:50 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:47:50 user nova-compute[74261]:       <nova:owner>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:user uuid="3ab08ea77d1c44588ce76ec801bfa11e">tempest-VolumesAdminNegativeTest-593462057-project-member</nova:user>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:project uuid="0bf4a57fa9484c8c8fc774664775226e">tempest-VolumesAdminNegativeTest-593462057</nova:project>
Oct 17 11:47:50 user nova-compute[74261]:       </nova:owner>
Oct 17 11:47:50 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:50 user nova-compute[74261]:       <nova:ports>
Oct 17 11:47:50 user nova-compute[74261]:         <nova:port uuid="3efb487a-23f5-44f0-a34e-1145c39c2241">
Oct 17 11:47:50 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 11:47:50 user nova-compute[74261]:         </nova:port>
Oct 17 11:47:50 user nova-compute[74261]:       </nova:ports>
Oct 17 11:47:50 user nova-compute[74261]:     </nova:instance>
Oct 17 11:47:50 user nova-compute[74261]:   </metadata>
Oct 17 11:47:50 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:47:50 user nova-compute[74261]:     <system>
Oct 17 11:47:50 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:47:50 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:47:50 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:47:50 user nova-compute[74261]:       <entry name="serial">68fa8b56-a6bb-4201-b1b0-29d50408673e</entry>
Oct 17 11:47:50 user nova-compute[74261]:       <entry name="uuid">68fa8b56-a6bb-4201-b1b0-29d50408673e</entry>
Oct 17 11:47:50 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:47:50 user nova-compute[74261]:     </system>
Oct 17 11:47:50 user nova-compute[74261]:   </sysinfo>
Oct 17 11:47:50 user nova-compute[74261]:   <os>
Oct 17 11:47:50 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:47:50 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:47:50 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:47:50 user nova-compute[74261]:   </os>
Oct 17 11:47:50 user nova-compute[74261]:   <features>
Oct 17 11:47:50 user nova-compute[74261]:     <acpi/>
Oct 17 11:47:50 user nova-compute[74261]:     <apic/>
Oct 17 11:47:50 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:47:50 user nova-compute[74261]:   </features>
Oct 17 11:47:50 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:47:50 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:47:50 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:47:50 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:47:50 user nova-compute[74261]:   </clock>
Oct 17 11:47:50 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:47:50 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:47:50 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:47:50 user nova-compute[74261]:   </cpu>
Oct 17 11:47:50 user nova-compute[74261]:   <devices>
Oct 17 11:47:50 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:47:50 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:47:50 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk"/>
Oct 17 11:47:50 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:47:50 user nova-compute[74261]:     </disk>
Oct 17 11:47:50 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:47:50 user nova-compute[74261]:       <mac address="fa:16:3e:c2:cc:83"/>
Oct 17 11:47:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:47:50 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:47:50 user nova-compute[74261]:       <target dev="tap3efb487a-23"/>
Oct 17 11:47:50 user nova-compute[74261]:     </interface>
Oct 17 11:47:50 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:47:50 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/console.log" append="off"/>
Oct 17 11:47:50 user nova-compute[74261]:     </serial>
Oct 17 11:47:50 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:47:50 user nova-compute[74261]:     <video>
Oct 17 11:47:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:47:50 user nova-compute[74261]:     </video>
Oct 17 11:47:50 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:47:50 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:47:50 user nova-compute[74261]:     </rng>
Oct 17 11:47:50 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:47:50 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:47:50 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:47:50 user nova-compute[74261]:     </memballoon>
Oct 17 11:47:50 user nova-compute[74261]:   </devices>
Oct 17 11:47:50 user nova-compute[74261]: </domain>
Oct 17 11:47:50 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-602880739',display_name='tempest-VolumesAdminNegativeTest-server-602880739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-602880739',id=13,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf4a57fa9484c8c8fc774664775226e',ramdisk_id='',reservation_id='r-02b9bbtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-593462057',owner_user_name='tempest-VolumesAdminNegativeTest-593462057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:47:49Z,user_data=None,user_id='3ab08ea77d1c44588ce76ec801bfa11e',uuid=68fa8b56-a6bb-4201-b1b0-29d50408673e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converting VIF {"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG os_vif [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66287e48-f54c-582f-b963-d56a8b8c5db2', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:50 user nova-compute[74261]: INFO nova.compute.manager [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Attaching volume 9e409f6a-94c2-4649-a458-7b85b4d00487 to /dev/vdb
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3efb487a-23, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3efb487a-23, col_values=(('qos', UUID('56933796-c319-4d72-b077-f36517121203')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3efb487a-23, col_values=(('external_ids', {'iface-id': '3efb487a-23f5-44f0-a34e-1145c39c2241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:cc:83', 'vm-uuid': '68fa8b56-a6bb-4201-b1b0-29d50408673e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:51 user nova-compute[74261]: INFO os_vif [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23')
Oct 17 11:47:51 user nova-compute[74261]: DEBUG os_brick.utils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f85d9e-a81b-49bc-84e0-e4e2299686f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e9117-0f45-4e1a-a84f-ae6b62627439]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] No VIF found with MAC fa:16:3e:c2:cc:83, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0a0fc-ec63-4700-b8f1-2c239b1359a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab1c869-8593-4634-b589-b142d981631f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:47:51 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1170cc3d-94b4-492e-9f99-7c3dc73da381]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG os_brick.utils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating existing volume attachment record: d38f18e8-3e20-4dab-aba8-775aee7ee1a1 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 246415360 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Updated VIF entry in instance network info cache for port 3efb487a-23f5-44f0-a34e-1145c39c2241. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Updating instance_info_cache with network_info: [{"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1bfe9cbe-6e72-41d6-8c87-58daedd8d2a7 req-79a545f7-3e81-4a9e-b4cb-1d9d2cf3ecb6 service nova] Releasing lock "refresh_cache-68fa8b56-a6bb-4201-b1b0-29d50408673e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:47:51 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.policy [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f29e0ea554e49c6b7ea83629e0f88c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92694390284b84b82715d4086494e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:47:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 423624704 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:47:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Creating image(s)
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.240s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 555745280 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk 1073741824" returned: 0 in 0.048s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Cannot resize image /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Ensure instance console log exists: /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 720371712 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Successfully created port: f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-1d791b6a-68a5-4037-8187-906193dbaed3 req-bc48cca6-88dc-431d-9a1e-09d538a32a35 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1d791b6a-68a5-4037-8187-906193dbaed3 req-bc48cca6-88dc-431d-9a1e-09d538a32a35 service nova] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1d791b6a-68a5-4037-8187-906193dbaed3 req-bc48cca6-88dc-431d-9a1e-09d538a32a35 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1d791b6a-68a5-4037-8187-906193dbaed3 req-bc48cca6-88dc-431d-9a1e-09d538a32a35 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-1d791b6a-68a5-4037-8187-906193dbaed3 req-bc48cca6-88dc-431d-9a1e-09d538a32a35 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] No waiting events found dispatching network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:53 user nova-compute[74261]: WARNING nova.compute.manager [req-1d791b6a-68a5-4037-8187-906193dbaed3 req-bc48cca6-88dc-431d-9a1e-09d538a32a35 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received unexpected event network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 for instance with vm_state building and task_state spawning.
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 866123776 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Waiting for libvirt event about the detach of device tap9c92b46a-db with device alias net1 from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 is timed out.
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface> {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 17 11:47:53 user nova-compute[74261]:   <name>instance-00000009</name>
Oct 17 11:47:53 user nova-compute[74261]:   <uuid>bfccfe8a-4414-44b0-9e94-12b6f7003406</uuid>
Oct 17 11:47:53 user nova-compute[74261]:   <metadata>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:53 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:46:30</nova:creationTime>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:47:53 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:53 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:owner>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:47:53 user nova-compute[74261]:   </nova:owner>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:ports>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:47:53 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:47:53 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:port uuid="9c92b46a-dbfa-4d44-89c8-48444dbc4d9b">
Oct 17 11:47:53 user nova-compute[74261]:       <nova:ip type="fixed" address="10.10.10.137" ipVersion="4"/>
Oct 17 11:47:53 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:53 user nova-compute[74261]:   </nova:ports>
Oct 17 11:47:53 user nova-compute[74261]: </nova:instance>
Oct 17 11:47:53 user nova-compute[74261]:   </metadata>
Oct 17 11:47:53 user nova-compute[74261]:   <memory unit='KiB'>524288</memory>
Oct 17 11:47:53 user nova-compute[74261]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 17 11:47:53 user nova-compute[74261]:   <vcpu placement='static'>1</vcpu>
Oct 17 11:47:53 user nova-compute[74261]:   <resource>
Oct 17 11:47:53 user nova-compute[74261]:     <partition>/machine</partition>
Oct 17 11:47:53 user nova-compute[74261]:   </resource>
Oct 17 11:47:53 user nova-compute[74261]:   <sysinfo type='smbios'>
Oct 17 11:47:53 user nova-compute[74261]:     <system>
Oct 17 11:47:53 user nova-compute[74261]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 17 11:47:53 user nova-compute[74261]:       <entry name='product'>OpenStack Nova</entry>
Oct 17 11:47:53 user nova-compute[74261]:       <entry name='version'>0.0.0</entry>
Oct 17 11:47:53 user nova-compute[74261]:       <entry name='serial'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:53 user nova-compute[74261]:       <entry name='uuid'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:53 user nova-compute[74261]:       <entry name='family'>Virtual Machine</entry>
Oct 17 11:47:53 user nova-compute[74261]:     </system>
Oct 17 11:47:53 user nova-compute[74261]:   </sysinfo>
Oct 17 11:47:53 user nova-compute[74261]:   <os>
Oct 17 11:47:53 user nova-compute[74261]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 17 11:47:53 user nova-compute[74261]:     <boot dev='hd'/>
Oct 17 11:47:53 user nova-compute[74261]:     <smbios mode='sysinfo'/>
Oct 17 11:47:53 user nova-compute[74261]:   </os>
Oct 17 11:47:53 user nova-compute[74261]:   <features>
Oct 17 11:47:53 user nova-compute[74261]:     <acpi/>
Oct 17 11:47:53 user nova-compute[74261]:     <apic/>
Oct 17 11:47:53 user nova-compute[74261]:     <vmcoreinfo state='on'/>
Oct 17 11:47:53 user nova-compute[74261]:   </features>
Oct 17 11:47:53 user nova-compute[74261]:   <cpu mode='custom' match='exact' check='full'>
Oct 17 11:47:53 user nova-compute[74261]:     <model fallback='forbid'>Nehalem</model>
Oct 17 11:47:53 user nova-compute[74261]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 17 11:47:53 user nova-compute[74261]:     <feature policy='require' name='vme'/>
Oct 17 11:47:53 user nova-compute[74261]:     <feature policy='require' name='x2apic'/>
Oct 17 11:47:53 user nova-compute[74261]:     <feature policy='require' name='hypervisor'/>
Oct 17 11:47:53 user nova-compute[74261]:   </cpu>
Oct 17 11:47:53 user nova-compute[74261]:   <clock offset='utc'>
Oct 17 11:47:53 user nova-compute[74261]:     <timer name='pit' tickpolicy='delay'/>
Oct 17 11:47:53 user nova-compute[74261]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 17 11:47:53 user nova-compute[74261]:     <timer name='hpet' present='no'/>
Oct 17 11:47:53 user nova-compute[74261]:   </clock>
Oct 17 11:47:53 user nova-compute[74261]:   <on_poweroff>destroy</on_poweroff>
Oct 17 11:47:53 user nova-compute[74261]:   <on_reboot>restart</on_reboot>
Oct 17 11:47:53 user nova-compute[74261]:   <on_crash>destroy</on_crash>
Oct 17 11:47:53 user nova-compute[74261]:   <devices>
Oct 17 11:47:53 user nova-compute[74261]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 17 11:47:53 user nova-compute[74261]:     <disk type='file' device='disk'>
Oct 17 11:47:53 user nova-compute[74261]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 17 11:47:53 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk' index='2'/>
Oct 17 11:47:53 user nova-compute[74261]:       <backingStore type='file' index='3'>
Oct 17 11:47:53 user nova-compute[74261]:         <format type='raw'/>
Oct 17 11:47:53 user nova-compute[74261]:         <source file='/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c'/>
Oct 17 11:47:53 user nova-compute[74261]:         <backingStore/>
Oct 17 11:47:53 user nova-compute[74261]:       </backingStore>
Oct 17 11:47:53 user nova-compute[74261]:       <target dev='vda' bus='virtio'/>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='virtio-disk0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </disk>
Oct 17 11:47:53 user nova-compute[74261]:     <disk type='file' device='cdrom'>
Oct 17 11:47:53 user nova-compute[74261]:       <driver name='qemu' type='raw' cache='none'/>
Oct 17 11:47:53 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config' index='1'/>
Oct 17 11:47:53 user nova-compute[74261]:       <backingStore/>
Oct 17 11:47:53 user nova-compute[74261]:       <target dev='hda' bus='ide'/>
Oct 17 11:47:53 user nova-compute[74261]:       <readonly/>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='ide0-0-0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </disk>
Oct 17 11:47:53 user nova-compute[74261]:     <controller type='usb' index='0' model='none'>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='usb'/>
Oct 17 11:47:53 user nova-compute[74261]:     </controller>
Oct 17 11:47:53 user nova-compute[74261]:     <controller type='pci' index='0' model='pci-root'>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='pci.0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </controller>
Oct 17 11:47:53 user nova-compute[74261]:     <controller type='ide' index='0'>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='ide'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 17 11:47:53 user nova-compute[74261]:     </controller>
Oct 17 11:47:53 user nova-compute[74261]:     <interface type='ethernet'>
Oct 17 11:47:53 user nova-compute[74261]:       <mac address='fa:16:3e:44:d7:13'/>
Oct 17 11:47:53 user nova-compute[74261]:       <target dev='tapc52b809b-bc'/>
Oct 17 11:47:53 user nova-compute[74261]:       <model type='virtio'/>
Oct 17 11:47:53 user nova-compute[74261]:       <mtu size='1442'/>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='net0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </interface>
Oct 17 11:47:53 user nova-compute[74261]:     <serial type='pty'>
Oct 17 11:47:53 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:53 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:53 user nova-compute[74261]:       <target type='isa-serial' port='0'>
Oct 17 11:47:53 user nova-compute[74261]:         <model name='isa-serial'/>
Oct 17 11:47:53 user nova-compute[74261]:       </target>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </serial>
Oct 17 11:47:53 user nova-compute[74261]:     <console type='pty' tty='/dev/pts/8'>
Oct 17 11:47:53 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:53 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:53 user nova-compute[74261]:       <target type='serial' port='0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </console>
Oct 17 11:47:53 user nova-compute[74261]:     <input type='mouse' bus='ps2'>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='input0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </input>
Oct 17 11:47:53 user nova-compute[74261]:     <input type='keyboard' bus='ps2'>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='input1'/>
Oct 17 11:47:53 user nova-compute[74261]:     </input>
Oct 17 11:47:53 user nova-compute[74261]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 17 11:47:53 user nova-compute[74261]:       <listen type='address' address='0.0.0.0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </graphics>
Oct 17 11:47:53 user nova-compute[74261]:     <audio id='1' type='none'/>
Oct 17 11:47:53 user nova-compute[74261]:     <video>
Oct 17 11:47:53 user nova-compute[74261]:       <model type='virtio' heads='1' primary='yes'/>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='video0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </video>
Oct 17 11:47:53 user nova-compute[74261]:     <memballoon model='virtio'>
Oct 17 11:47:53 user nova-compute[74261]:       <stats period='10'/>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='balloon0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </memballoon>
Oct 17 11:47:53 user nova-compute[74261]:     <rng model='virtio'>
Oct 17 11:47:53 user nova-compute[74261]:       <backend model='random'>/dev/urandom</backend>
Oct 17 11:47:53 user nova-compute[74261]:       <alias name='rng0'/>
Oct 17 11:47:53 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 17 11:47:53 user nova-compute[74261]:     </rng>
Oct 17 11:47:53 user nova-compute[74261]:   </devices>
Oct 17 11:47:53 user nova-compute[74261]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 17 11:47:53 user nova-compute[74261]:     <label>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</label>
Oct 17 11:47:53 user nova-compute[74261]:     <imagelabel>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</imagelabel>
Oct 17 11:47:53 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:53 user nova-compute[74261]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 17 11:47:53 user nova-compute[74261]:     <label>+64055:+108</label>
Oct 17 11:47:53 user nova-compute[74261]:     <imagelabel>+64055:+108</imagelabel>
Oct 17 11:47:53 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:53 user nova-compute[74261]: </domain>
Oct 17 11:47:53 user nova-compute[74261]:  {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 17 11:47:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully detached device tap9c92b46a-db from instance bfccfe8a-4414-44b0-9e94-12b6f7003406 from the live domain config.
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG os_vif [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c92b46a-db, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a78d7b5-2b2b-4373-b755-2b0247c4684b) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:53 user nova-compute[74261]: INFO os_vif [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db')
Oct 17 11:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:53 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:47:53</nova:creationTime>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:47:53 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:53 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:owner>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:47:53 user nova-compute[74261]:   </nova:owner>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:53 user nova-compute[74261]:   <nova:ports>
Oct 17 11:47:53 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:47:53 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:47:53 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:53 user nova-compute[74261]:   </nova:ports>
Oct 17 11:47:53 user nova-compute[74261]: </nova:instance>
Oct 17 11:47:53 user nova-compute[74261]:  {{(pid=74261) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 1010827264 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-deleted-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:54 user nova-compute[74261]: INFO nova.compute.manager [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Neutron deleted interface 9c92b46a-dbfa-4d44-89c8-48444dbc4d9b; detaching it from the instance and deleting it from the info cache
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.network.neutron [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquired lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.network.neutron [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsaiVrKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '581268bb-0446-41d6-8235-9e49d911ff87'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:47:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.objects.instance [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Lazy-loading 'system_metadata' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5928878-ac83-4447-89a2-6bc66744b0b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:47:54 user nova-compute[74261]: No targets found.
Oct 17 11:47:54 user nova-compute[74261]: iSNS:
Oct 17 11:47:54 user nova-compute[74261]: No targets found.
Oct 17 11:47:54 user nova-compute[74261]: STATIC:
Oct 17 11:47:54 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87
Oct 17 11:47:54 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:54 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:54 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:47:54 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:54 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:54 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:47:54 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:47:54 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:47:54 user nova-compute[74261]: FIRMWARE:
Oct 17 11:47:54 user nova-compute[74261]: No targets found.
Oct 17 11:47:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:47:54 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:47:54 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a8853-a65e-48b9-bb5c-30fec4d8ffad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.objects.instance [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Lazy-loading 'flavor' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5424beed-5ed4-42bd-a7d0-fe1ed518c745]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:54 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:54 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:47:54 user nova-compute[74261]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 (non-flash)
Oct 17 11:47:54 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:47:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b301be4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.objects.base [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Object Instance<bfccfe8a-4414-44b0-9e94-12b6f7003406> lazy-loaded attributes: system_metadata,flavor {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Converting VIF {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface> {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c3368-cb0f-45d2-a286-55c566da4829]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 17 11:47:54 user nova-compute[74261]:   <name>instance-00000009</name>
Oct 17 11:47:54 user nova-compute[74261]:   <uuid>bfccfe8a-4414-44b0-9e94-12b6f7003406</uuid>
Oct 17 11:47:54 user nova-compute[74261]:   <metadata>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:54 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:47:53</nova:creationTime>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:47:54 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:owner>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:owner>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:ports>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:47:54 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:47:54 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:ports>
Oct 17 11:47:54 user nova-compute[74261]: </nova:instance>
Oct 17 11:47:54 user nova-compute[74261]:   </metadata>
Oct 17 11:47:54 user nova-compute[74261]:   <memory unit='KiB'>524288</memory>
Oct 17 11:47:54 user nova-compute[74261]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 17 11:47:54 user nova-compute[74261]:   <vcpu placement='static'>1</vcpu>
Oct 17 11:47:54 user nova-compute[74261]:   <resource>
Oct 17 11:47:54 user nova-compute[74261]:     <partition>/machine</partition>
Oct 17 11:47:54 user nova-compute[74261]:   </resource>
Oct 17 11:47:54 user nova-compute[74261]:   <sysinfo type='smbios'>
Oct 17 11:47:54 user nova-compute[74261]:     <system>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='product'>OpenStack Nova</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='version'>0.0.0</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='serial'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='uuid'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='family'>Virtual Machine</entry>
Oct 17 11:47:54 user nova-compute[74261]:     </system>
Oct 17 11:47:54 user nova-compute[74261]:   </sysinfo>
Oct 17 11:47:54 user nova-compute[74261]:   <os>
Oct 17 11:47:54 user nova-compute[74261]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 17 11:47:54 user nova-compute[74261]:     <boot dev='hd'/>
Oct 17 11:47:54 user nova-compute[74261]:     <smbios mode='sysinfo'/>
Oct 17 11:47:54 user nova-compute[74261]:   </os>
Oct 17 11:47:54 user nova-compute[74261]:   <features>
Oct 17 11:47:54 user nova-compute[74261]:     <acpi/>
Oct 17 11:47:54 user nova-compute[74261]:     <apic/>
Oct 17 11:47:54 user nova-compute[74261]:     <vmcoreinfo state='on'/>
Oct 17 11:47:54 user nova-compute[74261]:   </features>
Oct 17 11:47:54 user nova-compute[74261]:   <cpu mode='custom' match='exact' check='full'>
Oct 17 11:47:54 user nova-compute[74261]:     <model fallback='forbid'>Nehalem</model>
Oct 17 11:47:54 user nova-compute[74261]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 17 11:47:54 user nova-compute[74261]:     <feature policy='require' name='vme'/>
Oct 17 11:47:54 user nova-compute[74261]:     <feature policy='require' name='x2apic'/>
Oct 17 11:47:54 user nova-compute[74261]:     <feature policy='require' name='hypervisor'/>
Oct 17 11:47:54 user nova-compute[74261]:   </cpu>
Oct 17 11:47:54 user nova-compute[74261]:   <clock offset='utc'>
Oct 17 11:47:54 user nova-compute[74261]:     <timer name='pit' tickpolicy='delay'/>
Oct 17 11:47:54 user nova-compute[74261]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 17 11:47:54 user nova-compute[74261]:     <timer name='hpet' present='no'/>
Oct 17 11:47:54 user nova-compute[74261]:   </clock>
Oct 17 11:47:54 user nova-compute[74261]:   <on_poweroff>destroy</on_poweroff>
Oct 17 11:47:54 user nova-compute[74261]:   <on_reboot>restart</on_reboot>
Oct 17 11:47:54 user nova-compute[74261]:   <on_crash>destroy</on_crash>
Oct 17 11:47:54 user nova-compute[74261]:   <devices>
Oct 17 11:47:54 user nova-compute[74261]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 17 11:47:54 user nova-compute[74261]:     <disk type='file' device='disk'>
Oct 17 11:47:54 user nova-compute[74261]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 17 11:47:54 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk' index='2'/>
Oct 17 11:47:54 user nova-compute[74261]:       <backingStore type='file' index='3'>
Oct 17 11:47:54 user nova-compute[74261]:         <format type='raw'/>
Oct 17 11:47:54 user nova-compute[74261]:         <source file='/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c'/>
Oct 17 11:47:54 user nova-compute[74261]:         <backingStore/>
Oct 17 11:47:54 user nova-compute[74261]:       </backingStore>
Oct 17 11:47:54 user nova-compute[74261]:       <target dev='vda' bus='virtio'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='virtio-disk0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </disk>
Oct 17 11:47:54 user nova-compute[74261]:     <disk type='file' device='cdrom'>
Oct 17 11:47:54 user nova-compute[74261]:       <driver name='qemu' type='raw' cache='none'/>
Oct 17 11:47:54 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config' index='1'/>
Oct 17 11:47:54 user nova-compute[74261]:       <backingStore/>
Oct 17 11:47:54 user nova-compute[74261]:       <target dev='hda' bus='ide'/>
Oct 17 11:47:54 user nova-compute[74261]:       <readonly/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='ide0-0-0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </disk>
Oct 17 11:47:54 user nova-compute[74261]:     <controller type='usb' index='0' model='none'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='usb'/>
Oct 17 11:47:54 user nova-compute[74261]:     </controller>
Oct 17 11:47:54 user nova-compute[74261]:     <controller type='pci' index='0' model='pci-root'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='pci.0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </controller>
Oct 17 11:47:54 user nova-compute[74261]:     <controller type='ide' index='0'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='ide'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 17 11:47:54 user nova-compute[74261]:     </controller>
Oct 17 11:47:54 user nova-compute[74261]:     <interface type='ethernet'>
Oct 17 11:47:54 user nova-compute[74261]:       <mac address='fa:16:3e:44:d7:13'/>
Oct 17 11:47:54 user nova-compute[74261]:       <target dev='tapc52b809b-bc'/>
Oct 17 11:47:54 user nova-compute[74261]:       <model type='virtio'/>
Oct 17 11:47:54 user nova-compute[74261]:       <mtu size='1442'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='net0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </interface>
Oct 17 11:47:54 user nova-compute[74261]:     <serial type='pty'>
Oct 17 11:47:54 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:54 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:54 user nova-compute[74261]:       <target type='isa-serial' port='0'>
Oct 17 11:47:54 user nova-compute[74261]:         <model name='isa-serial'/>
Oct 17 11:47:54 user nova-compute[74261]:       </target>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </serial>
Oct 17 11:47:54 user nova-compute[74261]:     <console type='pty' tty='/dev/pts/8'>
Oct 17 11:47:54 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:54 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:54 user nova-compute[74261]:       <target type='serial' port='0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </console>
Oct 17 11:47:54 user nova-compute[74261]:     <input type='mouse' bus='ps2'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='input0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </input>
Oct 17 11:47:54 user nova-compute[74261]:     <input type='keyboard' bus='ps2'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='input1'/>
Oct 17 11:47:54 user nova-compute[74261]:     </input>
Oct 17 11:47:54 user nova-compute[74261]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 17 11:47:54 user nova-compute[74261]:       <listen type='address' address='0.0.0.0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </graphics>
Oct 17 11:47:54 user nova-compute[74261]:     <audio id='1' type='none'/>
Oct 17 11:47:54 user nova-compute[74261]:     <video>
Oct 17 11:47:54 user nova-compute[74261]:       <model type='virtio' heads='1' primary='yes'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='video0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </video>
Oct 17 11:47:54 user nova-compute[74261]:     <memballoon model='virtio'>
Oct 17 11:47:54 user nova-compute[74261]:       <stats period='10'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='balloon0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </memballoon>
Oct 17 11:47:54 user nova-compute[74261]:     <rng model='virtio'>
Oct 17 11:47:54 user nova-compute[74261]:       <backend model='random'>/dev/urandom</backend>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='rng0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </rng>
Oct 17 11:47:54 user nova-compute[74261]:   </devices>
Oct 17 11:47:54 user nova-compute[74261]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 17 11:47:54 user nova-compute[74261]:     <label>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</label>
Oct 17 11:47:54 user nova-compute[74261]:     <imagelabel>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</imagelabel>
Oct 17 11:47:54 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:54 user nova-compute[74261]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 17 11:47:54 user nova-compute[74261]:     <label>+64055:+108</label>
Oct 17 11:47:54 user nova-compute[74261]:     <imagelabel>+64055:+108</imagelabel>
Oct 17 11:47:54 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:54 user nova-compute[74261]: </domain>
Oct 17 11:47:54 user nova-compute[74261]:  {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface> {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:b0:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c92b46a-db"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 17 11:47:54 user nova-compute[74261]:   <name>instance-00000009</name>
Oct 17 11:47:54 user nova-compute[74261]:   <uuid>bfccfe8a-4414-44b0-9e94-12b6f7003406</uuid>
Oct 17 11:47:54 user nova-compute[74261]:   <metadata>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:54 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:47:53</nova:creationTime>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:47:54 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:owner>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:owner>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:ports>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:47:54 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:47:54 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:ports>
Oct 17 11:47:54 user nova-compute[74261]: </nova:instance>
Oct 17 11:47:54 user nova-compute[74261]:   </metadata>
Oct 17 11:47:54 user nova-compute[74261]:   <memory unit='KiB'>524288</memory>
Oct 17 11:47:54 user nova-compute[74261]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 17 11:47:54 user nova-compute[74261]:   <vcpu placement='static'>1</vcpu>
Oct 17 11:47:54 user nova-compute[74261]:   <resource>
Oct 17 11:47:54 user nova-compute[74261]:     <partition>/machine</partition>
Oct 17 11:47:54 user nova-compute[74261]:   </resource>
Oct 17 11:47:54 user nova-compute[74261]:   <sysinfo type='smbios'>
Oct 17 11:47:54 user nova-compute[74261]:     <system>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='product'>OpenStack Nova</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='version'>0.0.0</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='serial'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='uuid'>bfccfe8a-4414-44b0-9e94-12b6f7003406</entry>
Oct 17 11:47:54 user nova-compute[74261]:       <entry name='family'>Virtual Machine</entry>
Oct 17 11:47:54 user nova-compute[74261]:     </system>
Oct 17 11:47:54 user nova-compute[74261]:   </sysinfo>
Oct 17 11:47:54 user nova-compute[74261]:   <os>
Oct 17 11:47:54 user nova-compute[74261]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 17 11:47:54 user nova-compute[74261]:     <boot dev='hd'/>
Oct 17 11:47:54 user nova-compute[74261]:     <smbios mode='sysinfo'/>
Oct 17 11:47:54 user nova-compute[74261]:   </os>
Oct 17 11:47:54 user nova-compute[74261]:   <features>
Oct 17 11:47:54 user nova-compute[74261]:     <acpi/>
Oct 17 11:47:54 user nova-compute[74261]:     <apic/>
Oct 17 11:47:54 user nova-compute[74261]:     <vmcoreinfo state='on'/>
Oct 17 11:47:54 user nova-compute[74261]:   </features>
Oct 17 11:47:54 user nova-compute[74261]:   <cpu mode='custom' match='exact' check='full'>
Oct 17 11:47:54 user nova-compute[74261]:     <model fallback='forbid'>Nehalem</model>
Oct 17 11:47:54 user nova-compute[74261]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 17 11:47:54 user nova-compute[74261]:     <feature policy='require' name='vme'/>
Oct 17 11:47:54 user nova-compute[74261]:     <feature policy='require' name='x2apic'/>
Oct 17 11:47:54 user nova-compute[74261]:     <feature policy='require' name='hypervisor'/>
Oct 17 11:47:54 user nova-compute[74261]:   </cpu>
Oct 17 11:47:54 user nova-compute[74261]:   <clock offset='utc'>
Oct 17 11:47:54 user nova-compute[74261]:     <timer name='pit' tickpolicy='delay'/>
Oct 17 11:47:54 user nova-compute[74261]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 17 11:47:54 user nova-compute[74261]:     <timer name='hpet' present='no'/>
Oct 17 11:47:54 user nova-compute[74261]:   </clock>
Oct 17 11:47:54 user nova-compute[74261]:   <on_poweroff>destroy</on_poweroff>
Oct 17 11:47:54 user nova-compute[74261]:   <on_reboot>restart</on_reboot>
Oct 17 11:47:54 user nova-compute[74261]:   <on_crash>destroy</on_crash>
Oct 17 11:47:54 user nova-compute[74261]:   <devices>
Oct 17 11:47:54 user nova-compute[74261]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 17 11:47:54 user nova-compute[74261]:     <disk type='file' device='disk'>
Oct 17 11:47:54 user nova-compute[74261]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 17 11:47:54 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk' index='2'/>
Oct 17 11:47:54 user nova-compute[74261]:       <backingStore type='file' index='3'>
Oct 17 11:47:54 user nova-compute[74261]:         <format type='raw'/>
Oct 17 11:47:54 user nova-compute[74261]:         <source file='/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c'/>
Oct 17 11:47:54 user nova-compute[74261]:         <backingStore/>
Oct 17 11:47:54 user nova-compute[74261]:       </backingStore>
Oct 17 11:47:54 user nova-compute[74261]:       <target dev='vda' bus='virtio'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='virtio-disk0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </disk>
Oct 17 11:47:54 user nova-compute[74261]:     <disk type='file' device='cdrom'>
Oct 17 11:47:54 user nova-compute[74261]:       <driver name='qemu' type='raw' cache='none'/>
Oct 17 11:47:54 user nova-compute[74261]:       <source file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk.config' index='1'/>
Oct 17 11:47:54 user nova-compute[74261]:       <backingStore/>
Oct 17 11:47:54 user nova-compute[74261]:       <target dev='hda' bus='ide'/>
Oct 17 11:47:54 user nova-compute[74261]:       <readonly/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='ide0-0-0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </disk>
Oct 17 11:47:54 user nova-compute[74261]:     <controller type='usb' index='0' model='none'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='usb'/>
Oct 17 11:47:54 user nova-compute[74261]:     </controller>
Oct 17 11:47:54 user nova-compute[74261]:     <controller type='pci' index='0' model='pci-root'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='pci.0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </controller>
Oct 17 11:47:54 user nova-compute[74261]:     <controller type='ide' index='0'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='ide'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 17 11:47:54 user nova-compute[74261]:     </controller>
Oct 17 11:47:54 user nova-compute[74261]:     <interface type='ethernet'>
Oct 17 11:47:54 user nova-compute[74261]:       <mac address='fa:16:3e:44:d7:13'/>
Oct 17 11:47:54 user nova-compute[74261]:       <target dev='tapc52b809b-bc'/>
Oct 17 11:47:54 user nova-compute[74261]:       <model type='virtio'/>
Oct 17 11:47:54 user nova-compute[74261]:       <mtu size='1442'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='net0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </interface>
Oct 17 11:47:54 user nova-compute[74261]:     <serial type='pty'>
Oct 17 11:47:54 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:54 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:54 user nova-compute[74261]:       <target type='isa-serial' port='0'>
Oct 17 11:47:54 user nova-compute[74261]:         <model name='isa-serial'/>
Oct 17 11:47:54 user nova-compute[74261]:       </target>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </serial>
Oct 17 11:47:54 user nova-compute[74261]:     <console type='pty' tty='/dev/pts/8'>
Oct 17 11:47:54 user nova-compute[74261]:       <source path='/dev/pts/8'/>
Oct 17 11:47:54 user nova-compute[74261]:       <log file='/opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/console.log' append='off'/>
Oct 17 11:47:54 user nova-compute[74261]:       <target type='serial' port='0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='serial0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </console>
Oct 17 11:47:54 user nova-compute[74261]:     <input type='mouse' bus='ps2'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='input0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </input>
Oct 17 11:47:54 user nova-compute[74261]:     <input type='keyboard' bus='ps2'>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='input1'/>
Oct 17 11:47:54 user nova-compute[74261]:     </input>
Oct 17 11:47:54 user nova-compute[74261]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 17 11:47:54 user nova-compute[74261]:       <listen type='address' address='0.0.0.0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </graphics>
Oct 17 11:47:54 user nova-compute[74261]:     <audio id='1' type='none'/>
Oct 17 11:47:54 user nova-compute[74261]:     <video>
Oct 17 11:47:54 user nova-compute[74261]:       <model type='virtio' heads='1' primary='yes'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='video0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </video>
Oct 17 11:47:54 user nova-compute[74261]:     <memballoon model='virtio'>
Oct 17 11:47:54 user nova-compute[74261]:       <stats period='10'/>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='balloon0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </memballoon>
Oct 17 11:47:54 user nova-compute[74261]:     <rng model='virtio'>
Oct 17 11:47:54 user nova-compute[74261]:       <backend model='random'>/dev/urandom</backend>
Oct 17 11:47:54 user nova-compute[74261]:       <alias name='rng0'/>
Oct 17 11:47:54 user nova-compute[74261]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 17 11:47:54 user nova-compute[74261]:     </rng>
Oct 17 11:47:54 user nova-compute[74261]:   </devices>
Oct 17 11:47:54 user nova-compute[74261]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 17 11:47:54 user nova-compute[74261]:     <label>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</label>
Oct 17 11:47:54 user nova-compute[74261]:     <imagelabel>libvirt-bfccfe8a-4414-44b0-9e94-12b6f7003406</imagelabel>
Oct 17 11:47:54 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:54 user nova-compute[74261]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 17 11:47:54 user nova-compute[74261]:     <label>+64055:+108</label>
Oct 17 11:47:54 user nova-compute[74261]:     <imagelabel>+64055:+108</imagelabel>
Oct 17 11:47:54 user nova-compute[74261]:   </seclabel>
Oct 17 11:47:54 user nova-compute[74261]: </domain>
Oct 17 11:47:54 user nova-compute[74261]:  {{(pid=74261) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 17 11:47:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Detaching interface fa:16:3e:6d:b0:9c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap9c92b46a-db' not found.
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Converting VIF {"id": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "address": "fa:16:3e:6d:b0:9c", "network": {"id": "70f1a363-1332-4845-bba9-1fdf9c0eeff6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1395009105", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c92b46a-db", "ovs_interfaceid": "9c92b46a-dbfa-4d44-89c8-48444dbc4d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_vif [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[812309a3-fa23-42cc-8940-8b83a9ae6002]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c92b46a-db, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: INFO os_vif [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c92b46a-dbfa-4d44-89c8-48444dbc4d9b,network=Network(70f1a363-1332-4845-bba9-1fdf9c0eeff6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c92b46a-db')
Oct 17 11:47:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [req-4dd4fcc6-a193-47cb-b51e-2c22cde28c76 req-7d13741f-78d0-42ee-9b54-6effe734d151 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:54 user nova-compute[74261]:   <nova:package version="0.0.0"/>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:name>tempest-device-tagging-server-318388657</nova:name>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:creationTime>2023-10-17 11:47:54</nova:creationTime>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:flavor name="m1.tiny">
Oct 17 11:47:54 user nova-compute[74261]:     <nova:memory>512</nova:memory>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:disk>1</nova:disk>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:swap>0</nova:swap>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:flavor>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:owner>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:user uuid="e6a380973f1c4684b1dca8d8ec8de410">tempest-TaggedAttachmentsTest-1458685808-project-member</nova:user>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:project uuid="e2b1386d00864d748f658ae72455d6fc">tempest-TaggedAttachmentsTest-1458685808</nova:project>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:owner>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:54 user nova-compute[74261]:   <nova:ports>
Oct 17 11:47:54 user nova-compute[74261]:     <nova:port uuid="c52b809b-bc53-45bf-b53d-58b724efacf7">
Oct 17 11:47:54 user nova-compute[74261]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:47:54 user nova-compute[74261]:     </nova:port>
Oct 17 11:47:54 user nova-compute[74261]:   </nova:ports>
Oct 17 11:47:54 user nova-compute[74261]: </nova:instance>
Oct 17 11:47:54 user nova-compute[74261]:  {{(pid=74261) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c6aa6-5511-4c0e-8871-fadcac25d826]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[217c9990-b844-4993-b0bf-90a01cd5e8ea]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f4145-bb0d-49d1-b742-6564cd3c2df0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec66364-45f1-45a6-9cf6-d1a1c8d2f849]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260]
Oct 17 11:47:55 user nova-compute[74261]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87, portal: 172.16.0.220,3260] successful.
Oct 17 11:47:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:581268bb-0446-41d6-8235-9e49d911ff87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f448ef67-ed37-4ffc-acd2-444ff87ba02a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] <== disconnect_volume: return (377ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Successfully updated port: f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:47:55 user nova-compute[74261]: INFO nova.network.neutron [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Port 9c92b46a-dbfa-4d44-89c8-48444dbc4d9b from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [{"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd0bc8ec6-6f50-4013-a360-71c64069ed2f', 'attached_at': '', 'detached_at': '', 'volume_id': '731b9014-4c69-45bb-a259-af5e67f2a74c', 'serial'} {{(pid=74261) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] swap_volume: removing Cinder connection for volume 581268bb-0446-41d6-8235-9e49d911ff87 {{(pid=74261) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Releasing lock "refresh_cache-bfccfe8a-4414-44b0-9e94-12b6f7003406" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-03f61167-f72b-4644-a3a9-826f4a542cb9 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "interface-bfccfe8a-4414-44b0-9e94-12b6f7003406-9c92b46a-dbfa-4d44-89c8-48444dbc4d9b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.056s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] No waiting events found dispatching network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:55 user nova-compute[74261]: WARNING nova.compute.manager [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received unexpected event network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 for instance with vm_state building and task_state spawning.
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-changed-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Refreshing instance network info cache due to event network-changed-f8cbb1c4-5281-4d70-b56b-2ae92919975d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] Acquiring lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updating instance_info_cache with network_info: [{"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:55 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Instance spawned successfully.
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance network_info: |[{"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] Acquired lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Refreshing network info cache for port f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Start _get_guest_xml network_info=[{"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:47:55 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:47:55 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1162149465',display_name='tempest-tempest.common.compute-instance-1162149465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1162149465',id=14,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtR0YqoFrpPiXCoSahrCHnyzfIwThm6AY9VcZpOP9PuSc0xow/4PNQ5MD7rsPe3keZvknND3j9KNhoqBhKSvmX4b1Dq/mfceVXOpv9yoUBcd7t3YcYhCVRllEahAKNTig==',key_name='tempest-keypair-848116821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-xt5s6fce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=0a85cfbd-143d-45e2-9529-71cdde5fad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.objects.instance [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:47:55 user nova-compute[74261]:   <uuid>0a85cfbd-143d-45e2-9529-71cdde5fad52</uuid>
Oct 17 11:47:55 user nova-compute[74261]:   <name>instance-0000000e</name>
Oct 17 11:47:55 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:47:55 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:47:55 user nova-compute[74261]:   <metadata>
Oct 17 11:47:55 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:47:55 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:47:55 user nova-compute[74261]:       <nova:name>tempest-tempest.common.compute-instance-1162149465</nova:name>
Oct 17 11:47:55 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:47:55</nova:creationTime>
Oct 17 11:47:55 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:47:55 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:47:55 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:47:55 user nova-compute[74261]:       <nova:owner>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:user uuid="4f29e0ea554e49c6b7ea83629e0f88c6">tempest-ServerActionsTestOtherA-203196858-project-member</nova:user>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:project uuid="8e92694390284b84b82715d4086494e9">tempest-ServerActionsTestOtherA-203196858</nova:project>
Oct 17 11:47:55 user nova-compute[74261]:       </nova:owner>
Oct 17 11:47:55 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:47:55 user nova-compute[74261]:       <nova:ports>
Oct 17 11:47:55 user nova-compute[74261]:         <nova:port uuid="f8cbb1c4-5281-4d70-b56b-2ae92919975d">
Oct 17 11:47:55 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 11:47:55 user nova-compute[74261]:         </nova:port>
Oct 17 11:47:55 user nova-compute[74261]:       </nova:ports>
Oct 17 11:47:55 user nova-compute[74261]:     </nova:instance>
Oct 17 11:47:55 user nova-compute[74261]:   </metadata>
Oct 17 11:47:55 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:47:55 user nova-compute[74261]:     <system>
Oct 17 11:47:55 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:47:55 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:47:55 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:47:55 user nova-compute[74261]:       <entry name="serial">0a85cfbd-143d-45e2-9529-71cdde5fad52</entry>
Oct 17 11:47:55 user nova-compute[74261]:       <entry name="uuid">0a85cfbd-143d-45e2-9529-71cdde5fad52</entry>
Oct 17 11:47:55 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:47:55 user nova-compute[74261]:     </system>
Oct 17 11:47:55 user nova-compute[74261]:   </sysinfo>
Oct 17 11:47:55 user nova-compute[74261]:   <os>
Oct 17 11:47:55 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:47:55 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:47:55 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:47:55 user nova-compute[74261]:   </os>
Oct 17 11:47:55 user nova-compute[74261]:   <features>
Oct 17 11:47:55 user nova-compute[74261]:     <acpi/>
Oct 17 11:47:55 user nova-compute[74261]:     <apic/>
Oct 17 11:47:55 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:47:55 user nova-compute[74261]:   </features>
Oct 17 11:47:55 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:47:55 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:47:55 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:47:55 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:47:55 user nova-compute[74261]:   </clock>
Oct 17 11:47:55 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:47:55 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:47:55 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:47:55 user nova-compute[74261]:   </cpu>
Oct 17 11:47:55 user nova-compute[74261]:   <devices>
Oct 17 11:47:55 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:47:55 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:47:55 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk"/>
Oct 17 11:47:55 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:47:55 user nova-compute[74261]:     </disk>
Oct 17 11:47:55 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:47:55 user nova-compute[74261]:       <mac address="fa:16:3e:51:4f:dc"/>
Oct 17 11:47:55 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:47:55 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:47:55 user nova-compute[74261]:       <target dev="tapf8cbb1c4-52"/>
Oct 17 11:47:55 user nova-compute[74261]:     </interface>
Oct 17 11:47:55 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:47:55 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/console.log" append="off"/>
Oct 17 11:47:55 user nova-compute[74261]:     </serial>
Oct 17 11:47:55 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:47:55 user nova-compute[74261]:     <video>
Oct 17 11:47:55 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:47:55 user nova-compute[74261]:     </video>
Oct 17 11:47:55 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:47:55 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:47:55 user nova-compute[74261]:     </rng>
Oct 17 11:47:55 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:47:55 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:47:55 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:47:55 user nova-compute[74261]:     </memballoon>
Oct 17 11:47:55 user nova-compute[74261]:   </devices>
Oct 17 11:47:55 user nova-compute[74261]: </domain>
Oct 17 11:47:55 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1162149465',display_name='tempest-tempest.common.compute-instance-1162149465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1162149465',id=14,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtR0YqoFrpPiXCoSahrCHnyzfIwThm6AY9VcZpOP9PuSc0xow/4PNQ5MD7rsPe3keZvknND3j9KNhoqBhKSvmX4b1Dq/mfceVXOpv9yoUBcd7t3YcYhCVRllEahAKNTig==',key_name='tempest-keypair-848116821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-xt5s6fce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=0a85cfbd-143d-45e2-9529-71cdde5fad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG os_vif [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc12b13a-e62d-579b-b635-b1cd05275523', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: INFO nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Took 6.79 seconds to spawn the instance on the hypervisor.
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8cbb1c4-52, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8cbb1c4-52, col_values=(('qos', UUID('4ef36f02-4841-468c-a443-4b329a3d8fbf')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8cbb1c4-52, col_values=(('external_ids', {'iface-id': 'f8cbb1c4-5281-4d70-b56b-2ae92919975d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:4f:dc', 'vm-uuid': '0a85cfbd-143d-45e2-9529-71cdde5fad52'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:55 user nova-compute[74261]: INFO os_vif [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52')
Oct 17 11:47:55 user nova-compute[74261]: INFO nova.compute.manager [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Took 7.89 seconds to build instance.
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No VIF found with MAC fa:16:3e:51:4f:dc, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:47:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7c1876c4-3f7a-47f1-94be-034b5a49d308 tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.034s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updated VIF entry in instance network info cache for port f8cbb1c4-5281-4d70-b56b-2ae92919975d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:47:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updating instance_info_cache with network_info: [{"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:47:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6e4f27c0-8044-4cae-abcc-03e9193027e7 req-210067d6-0f51-455a-a5c3-ffb2ed2e56b7 service nova] Releasing lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-deb9ab9b-64f5-4c41-9e90-f9e28c8b7c1b req-1655bdb2-42ef-4737-8134-b548ecdd972f service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-deb9ab9b-64f5-4c41-9e90-f9e28c8b7c1b req-1655bdb2-42ef-4737-8134-b548ecdd972f service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-deb9ab9b-64f5-4c41-9e90-f9e28c8b7c1b req-1655bdb2-42ef-4737-8134-b548ecdd972f service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-deb9ab9b-64f5-4c41-9e90-f9e28c8b7c1b req-1655bdb2-42ef-4737-8134-b548ecdd972f service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-deb9ab9b-64f5-4c41-9e90-f9e28c8b7c1b req-1655bdb2-42ef-4737-8134-b548ecdd972f service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:57 user nova-compute[74261]: WARNING nova.compute.manager [req-deb9ab9b-64f5-4c41-9e90-f9e28c8b7c1b req-1655bdb2-42ef-4737-8134-b548ecdd972f service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state building and task_state spawning.
Oct 17 11:47:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-1457d21a-8094-4fd4-a86b-112fad0a90f9 req-05106fb9-66fc-4f09-946b-f57ebd5faa61 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:47:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1457d21a-8094-4fd4-a86b-112fad0a90f9 req-05106fb9-66fc-4f09-946b-f57ebd5faa61 service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:47:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1457d21a-8094-4fd4-a86b-112fad0a90f9 req-05106fb9-66fc-4f09-946b-f57ebd5faa61 service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:47:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1457d21a-8094-4fd4-a86b-112fad0a90f9 req-05106fb9-66fc-4f09-946b-f57ebd5faa61 service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:47:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-1457d21a-8094-4fd4-a86b-112fad0a90f9 req-05106fb9-66fc-4f09-946b-f57ebd5faa61 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:47:59 user nova-compute[74261]: WARNING nova.compute.manager [req-1457d21a-8094-4fd4-a86b-112fad0a90f9 req-05106fb9-66fc-4f09-946b-f57ebd5faa61 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state building and task_state spawning.
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:48:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance spawned successfully.
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:00 user nova-compute[74261]: INFO nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Took 8.23 seconds to spawn the instance on the hypervisor.
Oct 17 11:48:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:48:00 user nova-compute[74261]: INFO nova.compute.manager [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Took 9.63 seconds to build instance.
Oct 17 11:48:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11af5e1d-4b94-4522-8552-83bb3860090d tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.785s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:48:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG nova.objects.instance [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lazy-loading 'flavor' on Instance uuid 6873f406-8c93-4d9d-b0d5-92296614b94b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:04 user nova-compute[74261]: INFO nova.compute.manager [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Attaching volume baa37e3c-4eac-409e-8013-af337762c9a1 to /dev/vdb
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG os_brick.utils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4125d3-0598-41ec-85fa-cb4def433a03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af554ff-4c6d-40de-885b-46fd1511cc6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca21f8a2-8260-443c-ab0a-17e9afadb628]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0822c6-90ed-4173-900f-9bfa3319bece]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:48:04 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2dcf53-77a5-4c6c-b042-d7d7a2c02679]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG os_brick.utils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updating existing volume attachment record: 350cf79f-2b30-445f-81e3-67ebde6a0352 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:48:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:48:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=25.55276107788086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance bfccfe8a-4414-44b0-9e94-12b6f7003406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d0bc8ec6-6f50-4013-a360-71c64069ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance ea0ea436-4137-4c76-b12b-9d68f8646825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 68fa8b56-a6bb-4201-b1b0-29d50408673e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:48:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:48:10 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:48:10 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:48:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:48:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.921s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] swap_volume: Updating volume 581268bb-0446-41d6-8235-9e49d911ff87 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "YOLbhCWF", "auth_password": "7clk4WEC9vRfgx", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "731b9014-4c69-45bb-a259-af5e67f2a74c"}, "status": "reserved", "instance": "d0bc8ec6-6f50-4013-a360-71c64069ed2f", "attached_at": "", "detached_at": "", "volume_id": "731b9014-4c69-45bb-a259-af5e67f2a74c", "serial": "731b9014-4c69-45bb-a259-af5e67f2a74c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '731b9014-4c69-45bb-a259-af5e67f2a74c', 'no_device': None, 'attachment_id': '154e375f-8a55-48a8-824c-39e1f8a47151'} {{(pid=74261) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 17 11:48:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b6ca786-a1e9-47da-9c89-f477dd54fbab tempest-TestVolumeSwap-1214599602 tempest-TestVolumeSwap-1214599602-project-admin] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 43.067s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.volume.cinder [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Update attachment failed for attachment 350cf79f-2b30-445f-81e3-67ebde6a0352. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-352ffd69-69b4-450f-b71f-ed65f7a5128f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-352ffd69-69b4-450f-b71f-ed65f7a5128f)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Failed to attach baa37e3c-4eac-409e-8013-af337762c9a1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-352ffd69-69b4-450f-b71f-ed65f7a5128f)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Traceback (most recent call last):
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     self._do_attach(context, instance, volume, volume_api,
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     self._volume_attach(context, volume, connector, instance,
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     connection_info = volume_api.attachment_update(
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     res = method(self, ctx, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     with excutils.save_and_reraise_exception():
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     self.force_reraise()
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     raise self.value
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     return method.func(obj, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     resp = self._update('/attachments/%s' % id, body)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     return self.request(url, method, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b]     raise exceptions.from_response(resp, body)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-352ffd69-69b4-450f-b71f-ed65f7a5128f)
Oct 17 11:48:14 user nova-compute[74261]: ERROR nova.compute.manager [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] 
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:14 user nova-compute[74261]: INFO nova.compute.manager [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Terminating instance
Oct 17 11:48:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.999s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsjmvIFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:48:14 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:14 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:14 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:48:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260" returned: 21 in 0.071s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786e548-7cc8-401f-88a4-d90c156b692b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:48:14 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e44d31-70a8-40f0-b70a-f139ff6a5f7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487] added
Oct 17 11:48:14 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.118s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8e44e-9e9a-4a15-9c4d-826a421a2d79]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad903217-105d-4ad9-8235-a24072de4101]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsjmvIFg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsjmvIFg" returned: 0 in 0.153s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1098fc3-4471-44b0-9155-c23fdb190686]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wsjmvIFg'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.207s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc6e632-58d3-4d4c-bfbe-e806fd25d31d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f73f45e-9da6-4463-8928-2e943686c3af]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:14 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:14 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:14 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:14 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server [None req-21e77e3b-d2d5-45c1-bd75-c4f130fce0eb tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-352ffd69-69b4-450f-b71f-ed65f7a5128f)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-352ffd69-69b4-450f-b71f-ed65f7a5128f)
Oct 17 11:48:14 user nova-compute[74261]: ERROR oslo_messaging.rpc.server 
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018a081-1e50-47f7-bee5-de28ad1e50e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260]
Oct 17 11:48:14 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260] successful.
Oct 17 11:48:14 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-99818fad-499f-4e82-8edd-df4da2e246e1 req-bd79aaa5-3acc-424b-b68d-9844c04ea510 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-vif-unplugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-99818fad-499f-4e82-8edd-df4da2e246e1 req-bd79aaa5-3acc-424b-b68d-9844c04ea510 service nova] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-99818fad-499f-4e82-8edd-df4da2e246e1 req-bd79aaa5-3acc-424b-b68d-9844c04ea510 service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-99818fad-499f-4e82-8edd-df4da2e246e1 req-bd79aaa5-3acc-424b-b68d-9844c04ea510 service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-99818fad-499f-4e82-8edd-df4da2e246e1 req-bd79aaa5-3acc-424b-b68d-9844c04ea510 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] No waiting events found dispatching network-vif-unplugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-99818fad-499f-4e82-8edd-df4da2e246e1 req-bd79aaa5-3acc-424b-b68d-9844c04ea510 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-vif-unplugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[696cc8c2-c5d8-40cd-8e2e-ad02d99d0870]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e669875-3c40-4072-a024-526d2241a29f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:15 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:15 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:15 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:15 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.820s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a39975-35c3-445b-ab7f-8fcd24c102a0]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsjmvIFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.compute.manager [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Detaching volume 731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.virt.block_device [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Attempting to driver detach volume 731b9014-4c69-45bb-a259-af5e67f2a74c from mountpoint /dev/vdb
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Attempting to detach device vdb from instance d0bc8ec6-6f50-4013-a360-71c64069ed2f from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:48:15 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:48:15 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:48:15 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:48:15 user nova-compute[74261]:   <serial>731b9014-4c69-45bb-a259-af5e67f2a74c</serial>
Oct 17 11:48:15 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:48:15 user nova-compute[74261]: </disk>
Oct 17 11:48:15 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Successfully detached device vdb from instance d0bc8ec6-6f50-4013-a360-71c64069ed2f from the persistent domain config.
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0bc8ec6-6f50-4013-a360-71c64069ed2f from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:48:15 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:48:15 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:48:15 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:48:15 user nova-compute[74261]:   <serial>731b9014-4c69-45bb-a259-af5e67f2a74c</serial>
Oct 17 11:48:15 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:48:15 user nova-compute[74261]: </disk>
Oct 17 11:48:15 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.compute.claims [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Claim successful on node user
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Instance destroyed successfully.
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lazy-loading 'resources' on Instance uuid ea0ea436-4137-4c76-b12b-9d68f8646825 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1698857625',display_name='tempest-VolumesAssistedSnapshotsTest-server-1698857625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1698857625',id=11,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBmHblHkcfqGj/kxwuSM4xuabPqkyXfnyU/KHs9A1nTAj15P/NxLio9TIIXbZjr7GDv8u1EBMaLK9TbGf1CZkHnB6w5oeDVAIHQF6S5VbVqBMs+bA74JC+dYKtwKM20Fg==',key_name='tempest-keypair-1531965803',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81a2faca67694807aaf9afae93249fe1',ramdisk_id='',reservation_id='r-b5ie824j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-181164323',owner_user_name='tempest-VolumesAssistedSnapshotsTest-181164323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a6ba3cb987b4c2795e52e4184fd1e5e',uuid=ea0ea436-4137-4c76-b12b-9d68f8646825,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Converting VIF {"id": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "address": "fa:16:3e:44:66:b0", "network": {"id": "89d571bc-bc39-4fef-961c-5ba59debc167", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-569282923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81a2faca67694807aaf9afae93249fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0662753-f3", "ovs_interfaceid": "b0662753-f337-4936-ac4f-6dd0f83f7bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG os_vif [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0662753-f3, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=753bb464-9a3f-475c-8de5-37e9035849a6) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:15 user nova-compute[74261]: INFO os_vif [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:66:b0,bridge_name='br-int',has_traffic_filtering=True,id=b0662753-f337-4936-ac4f-6dd0f83f7bfb,network=Network(89d571bc-bc39-4fef-961c-5ba59debc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0662753-f3')
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Deleting instance files /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825_del
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Deletion of /opt/stack/data/nova/instances/ea0ea436-4137-4c76-b12b-9d68f8646825_del complete
Oct 17 11:48:15 user nova-compute[74261]: INFO nova.compute.manager [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Took 1.81 seconds to destroy the instance on the hypervisor.
Oct 17 11:48:15 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:48:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.874s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] <== connect_volume: return (1877ms) {'type': 'block', 'scsi_wwn': '23761633936643337', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761633936643337', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'flavor' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:48:16 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:48:16 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:48:16 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:48:16 user nova-compute[74261]:   <serial>9e409f6a-94c2-4649-a458-7b85b4d00487</serial>
Oct 17 11:48:16 user nova-compute[74261]: </disk>
Oct 17 11:48:16 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:48:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.policy [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '126186127bc44a85ac39bb6bfbb0b8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe4687b8ef41248f726f6ddd948216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:48:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Creating image(s)
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No VIF found with MAC fa:16:3e:38:0c:0e, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-85eb728b-ef76-4d15-bf81-946f815d731b req-ff9fba6d-f674-48ee-a224-8e35a18910d2 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-vif-deleted-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:16 user nova-compute[74261]: INFO nova.compute.manager [req-85eb728b-ef76-4d15-bf81-946f815d731b req-ff9fba6d-f674-48ee-a224-8e35a18910d2 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Neutron deleted interface b0662753-f337-4936-ac4f-6dd0f83f7bfb; detaching it from the instance and deleting it from the info cache
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-85eb728b-ef76-4d15-bf81-946f815d731b req-ff9fba6d-f674-48ee-a224-8e35a18910d2 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk 1073741824" returned: 0 in 0.073s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:16 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Took 1.00 seconds to deallocate network for instance.
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0e7df751-1c82-496d-87d2-4e8609409175 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.930s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-85eb728b-ef76-4d15-bf81-946f815d731b req-ff9fba6d-f674-48ee-a224-8e35a18910d2 service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Detach interface failed, port_id=b0662753-f337-4936-ac4f-6dd0f83f7bfb, reason: Instance ea0ea436-4137-4c76-b12b-9d68f8646825 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Successfully created port: fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-f3d06d8b-093c-4991-9f6a-6d6b5aac0a2c req-c3f75102-728d-479b-a4e6-42eb0cea4a0b service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received event network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f3d06d8b-093c-4991-9f6a-6d6b5aac0a2c req-c3f75102-728d-479b-a4e6-42eb0cea4a0b service nova] Acquiring lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f3d06d8b-093c-4991-9f6a-6d6b5aac0a2c req-c3f75102-728d-479b-a4e6-42eb0cea4a0b service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f3d06d8b-093c-4991-9f6a-6d6b5aac0a2c req-c3f75102-728d-479b-a4e6-42eb0cea4a0b service nova] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-f3d06d8b-093c-4991-9f6a-6d6b5aac0a2c req-c3f75102-728d-479b-a4e6-42eb0cea4a0b service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] No waiting events found dispatching network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:17 user nova-compute[74261]: WARNING nova.compute.manager [req-f3d06d8b-093c-4991-9f6a-6d6b5aac0a2c req-c3f75102-728d-479b-a4e6-42eb0cea4a0b service nova] [instance: ea0ea436-4137-4c76-b12b-9d68f8646825] Received unexpected event network-vif-plugged-b0662753-f337-4936-ac4f-6dd0f83f7bfb for instance with vm_state deleted and task_state None.
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Cannot resize image /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Ensure instance console log exists: /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:17 user nova-compute[74261]: INFO nova.compute.manager [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Rescuing
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:17 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Deleted allocations for instance ea0ea436-4137-4c76-b12b-9d68f8646825
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3141dd3b-13f6-4d07-abe0-eb9b870ad88f tempest-VolumesAssistedSnapshotsTest-181164323 tempest-VolumesAssistedSnapshotsTest-181164323-project-member] Lock "ea0ea436-4137-4c76-b12b-9d68f8646825" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Successfully updated port: fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquired lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-changed-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Refreshing instance network info cache due to event network-changed-fb97e961-7b9b-4ea0-9071-85eb30c77ef6. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] Acquiring lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:48:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updating instance_info_cache with network_info: [{"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Releasing lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Instance network_info: |[{"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] Acquired lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.neutron [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Refreshing network info cache for port fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Start _get_guest_xml network_info=[{"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:48:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960084811',display_name='tempest-AttachVolumeNegativeTest-server-1960084811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960084811',id=15,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFVMwBC3cVbD2p4BrThPeCE+nrGRit6b1SsfGWcSI5EhTiJxiYJeLOs+KjaUWMZj19qH37v21L7TJVRbphJhRAXUmmhg4o193q677PnnysnVlm1y6JBO6ljbzWrZgaMxw==',key_name='tempest-keypair-497986224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-ld35ey99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=a8ffb39b-874a-484d-9171-293bf5245fdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.objects.instance [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'pci_devices' on Instance uuid a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:48:18 user nova-compute[74261]:   <uuid>a8ffb39b-874a-484d-9171-293bf5245fdd</uuid>
Oct 17 11:48:18 user nova-compute[74261]:   <name>instance-0000000f</name>
Oct 17 11:48:18 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:48:18 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:48:18 user nova-compute[74261]:   <metadata>
Oct 17 11:48:18 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:48:18 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:48:18 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1960084811</nova:name>
Oct 17 11:48:18 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:48:18</nova:creationTime>
Oct 17 11:48:18 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:48:18 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:48:18 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:48:18 user nova-compute[74261]:       <nova:owner>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:user uuid="126186127bc44a85ac39bb6bfbb0b8c6">tempest-AttachVolumeNegativeTest-1274994880-project-member</nova:user>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:project uuid="c2fe4687b8ef41248f726f6ddd948216">tempest-AttachVolumeNegativeTest-1274994880</nova:project>
Oct 17 11:48:18 user nova-compute[74261]:       </nova:owner>
Oct 17 11:48:18 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:48:18 user nova-compute[74261]:       <nova:ports>
Oct 17 11:48:18 user nova-compute[74261]:         <nova:port uuid="fb97e961-7b9b-4ea0-9071-85eb30c77ef6">
Oct 17 11:48:18 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 17 11:48:18 user nova-compute[74261]:         </nova:port>
Oct 17 11:48:18 user nova-compute[74261]:       </nova:ports>
Oct 17 11:48:18 user nova-compute[74261]:     </nova:instance>
Oct 17 11:48:18 user nova-compute[74261]:   </metadata>
Oct 17 11:48:18 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:48:18 user nova-compute[74261]:     <system>
Oct 17 11:48:18 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:48:18 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:48:18 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:48:18 user nova-compute[74261]:       <entry name="serial">a8ffb39b-874a-484d-9171-293bf5245fdd</entry>
Oct 17 11:48:18 user nova-compute[74261]:       <entry name="uuid">a8ffb39b-874a-484d-9171-293bf5245fdd</entry>
Oct 17 11:48:18 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:48:18 user nova-compute[74261]:     </system>
Oct 17 11:48:18 user nova-compute[74261]:   </sysinfo>
Oct 17 11:48:18 user nova-compute[74261]:   <os>
Oct 17 11:48:18 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:48:18 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:48:18 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:48:18 user nova-compute[74261]:   </os>
Oct 17 11:48:18 user nova-compute[74261]:   <features>
Oct 17 11:48:18 user nova-compute[74261]:     <acpi/>
Oct 17 11:48:18 user nova-compute[74261]:     <apic/>
Oct 17 11:48:18 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:48:18 user nova-compute[74261]:   </features>
Oct 17 11:48:18 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:48:18 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:48:18 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:48:18 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:48:18 user nova-compute[74261]:   </clock>
Oct 17 11:48:18 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:48:18 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:48:18 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:48:18 user nova-compute[74261]:   </cpu>
Oct 17 11:48:18 user nova-compute[74261]:   <devices>
Oct 17 11:48:18 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:48:18 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:48:18 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk"/>
Oct 17 11:48:18 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:48:18 user nova-compute[74261]:     </disk>
Oct 17 11:48:18 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:48:18 user nova-compute[74261]:       <mac address="fa:16:3e:67:b9:e1"/>
Oct 17 11:48:18 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:48:18 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:48:18 user nova-compute[74261]:       <target dev="tapfb97e961-7b"/>
Oct 17 11:48:18 user nova-compute[74261]:     </interface>
Oct 17 11:48:18 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:48:18 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/console.log" append="off"/>
Oct 17 11:48:18 user nova-compute[74261]:     </serial>
Oct 17 11:48:18 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:48:18 user nova-compute[74261]:     <video>
Oct 17 11:48:18 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:48:18 user nova-compute[74261]:     </video>
Oct 17 11:48:18 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:48:18 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:48:18 user nova-compute[74261]:     </rng>
Oct 17 11:48:18 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:48:18 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:48:18 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:48:18 user nova-compute[74261]:     </memballoon>
Oct 17 11:48:18 user nova-compute[74261]:   </devices>
Oct 17 11:48:18 user nova-compute[74261]: </domain>
Oct 17 11:48:18 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960084811',display_name='tempest-AttachVolumeNegativeTest-server-1960084811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960084811',id=15,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFVMwBC3cVbD2p4BrThPeCE+nrGRit6b1SsfGWcSI5EhTiJxiYJeLOs+KjaUWMZj19qH37v21L7TJVRbphJhRAXUmmhg4o193q677PnnysnVlm1y6JBO6ljbzWrZgaMxw==',key_name='tempest-keypair-497986224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-ld35ey99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=a8ffb39b-874a-484d-9171-293bf5245fdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG os_vif [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04acf7ba-01ef-533a-abaf-ad0a157e9728', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb97e961-7b, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb97e961-7b, col_values=(('qos', UUID('d2b4ddec-29ee-4131-9c50-d8f5a0c96785')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb97e961-7b, col_values=(('external_ids', {'iface-id': 'fb97e961-7b9b-4ea0-9071-85eb30c77ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:b9:e1', 'vm-uuid': 'a8ffb39b-874a-484d-9171-293bf5245fdd'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: INFO os_vif [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b')
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:67:b9:e1, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.neutron [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updated VIF entry in instance network info cache for port fb97e961-7b9b-4ea0-9071-85eb30c77ef6. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.network.neutron [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updating instance_info_cache with network_info: [{"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3e757724-9c28-4e14-94a3-4ae198eb717f req-063f4727-4a99-491f-82ad-bdadddcab4b8 service nova] Releasing lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:18 user nova-compute[74261]: WARNING nova.compute.manager [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state active and task_state rescuing.
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:18 user nova-compute[74261]: WARNING nova.compute.manager [req-bab1b001-447e-4cdf-8248-12730d5ed208 req-f5604a18-1f26-4b94-8c55-776386a04e89 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state active and task_state rescuing.
Oct 17 11:48:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance destroyed successfully.
Oct 17 11:48:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Attempting a stable device rescue
Oct 17 11:48:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74261) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 11:48:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 11:48:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Creating image(s)
Oct 17 11:48:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:19 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'trusted_certs' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "d9689639cd8a87c316d9297886b63bcef90802b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "d9689639cd8a87c316d9297886b63bcef90802b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b5d0d79-8c96-4f6e-9d4e-318316c2b20e req-7d88e900-e2ea-48f0-82e0-703474b2adf4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b5d0d79-8c96-4f6e-9d4e-318316c2b20e req-7d88e900-e2ea-48f0-82e0-703474b2adf4 service nova] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b5d0d79-8c96-4f6e-9d4e-318316c2b20e req-7d88e900-e2ea-48f0-82e0-703474b2adf4 service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b5d0d79-8c96-4f6e-9d4e-318316c2b20e req-7d88e900-e2ea-48f0-82e0-703474b2adf4 service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b5d0d79-8c96-4f6e-9d4e-318316c2b20e req-7d88e900-e2ea-48f0-82e0-703474b2adf4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] No waiting events found dispatching network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:20 user nova-compute[74261]: WARNING nova.compute.manager [req-5b5d0d79-8c96-4f6e-9d4e-318316c2b20e req-7d88e900-e2ea-48f0-82e0-703474b2adf4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received unexpected event network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 for instance with vm_state building and task_state spawning.
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG nova.virt.images [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] d611edde-3a36-4ddf-ae99-29526fce073e was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.part /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.part /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.converted" returned: 0 in 0.336s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "d9689639cd8a87c316d9297886b63bcef90802b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.590s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "d9689639cd8a87c316d9297886b63bcef90802b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "d9689639cd8a87c316d9297886b63bcef90802b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0,backing_fmt=raw /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0,backing_fmt=raw /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue" returned: 0 in 0.045s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "d9689639cd8a87c316d9297886b63bcef90802b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'migration_context' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Object Instance<f07110f1-a355-47f2-9243-620b6ca41584> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Start _get_guest_xml network_info=[{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "vif_mac": "fa:16:3e:38:0c:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd611edde-3a36-4ddf-ae99-29526fce073e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'd38f18e8-3e20-4dab-aba8-775aee7ee1a1', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsjmvIFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f07110f1-a355-47f2-9243-620b6ca41584', 'attached_at': '', 'detached_at': '', 'volume_id': '9e409f6a-94c2-4649-a458-7b85b4d00487', 'serial': '9e409f6a-94c2-4649-a458-7b85b4d00487'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'resources' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Object Instance<f07110f1-a355-47f2-9243-620b6ca41584> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'numa_topology' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Object Instance<f07110f1-a355-47f2-9243-620b6ca41584> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'vcpu_model' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Object Instance<f07110f1-a355-47f2-9243-620b6ca41584> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsjmvIFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:48:21 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:21 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:21 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeb7100-855c-49b6-aaa2-01ea44fc7cd9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wsjmvIFg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 17 11:48:21 user nova-compute[74261]: node.name = iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:48:21 user nova-compute[74261]: node.tpgt = -1
Oct 17 11:48:21 user nova-compute[74261]: node.startup = automatic
Oct 17 11:48:21 user nova-compute[74261]: node.leading_login = No
Oct 17 11:48:21 user nova-compute[74261]: iface.iscsi_ifacename = default
Oct 17 11:48:21 user nova-compute[74261]: iface.net_ifacename = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.ipaddress = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.prefix_len = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.hwaddress = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.transport_name = tcp
Oct 17 11:48:21 user nova-compute[74261]: iface.initiatorname = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.vlan_id = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.vlan_priority = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.vlan_state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.iface_num = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.mtu = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.port = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.bootproto = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.subnet_mask = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.gateway = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_alt_client_id_state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_alt_client_id = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_dns = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_learn_iqn = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_req_vendor_id_state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_vendor_id_state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_vendor_id = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.dhcp_slp_da = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.fragmentation = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.gratuitous_arp = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.incoming_forwarding = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.tos_state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.tos = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.ttl = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.delayed_ack = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.tcp_nagle = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.tcp_wsf_state = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.tcp_wsf = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.tcp_timer_scale = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.tcp_timestamp = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.redirect = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.def_task_mgmt_timeout = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.header_digest = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.data_digest = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.immediate_data = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.initial_r2t = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.data_seq_inorder = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.data_pdu_inorder = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.erl = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.max_receive_data_len = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.first_burst_len = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.max_outstanding_r2t = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.max_burst_len = 0
Oct 17 11:48:21 user nova-compute[74261]: iface.chap_auth = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.bidi_chap = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.strict_login_compliance = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.discovery_auth = <empty>
Oct 17 11:48:21 user nova-compute[74261]: iface.discovery_logout = <empty>
Oct 17 11:48:21 user nova-compute[74261]: node.discovery_address = <empty>
Oct 17 11:48:21 user nova-compute[74261]: node.discovery_port = 0
Oct 17 11:48:21 user nova-compute[74261]: node.discovery_type = static
Oct 17 11:48:21 user nova-compute[74261]: node.session.initial_cmdsn = 0
Oct 17 11:48:21 user nova-compute[74261]: node.session.initial_login_retry_max = 8
Oct 17 11:48:21 user nova-compute[74261]: node.session.xmit_thread_priority = -20
Oct 17 11:48:21 user nova-compute[74261]: node.session.cmds_max = 128
Oct 17 11:48:21 user nova-compute[74261]: node.session.queue_depth = 32
Oct 17 11:48:21 user nova-compute[74261]: node.session.nr_sessions = 1
Oct 17 11:48:21 user nova-compute[74261]: node.session.auth.authmethod = CHAP
Oct 17 11:48:21 user nova-compute[74261]: node.session.auth.username = wsjmvIFg
Oct 17 11:48:21 user nova-compute[74261]: node.session.auth.password = ***
Oct 17 11:48:21 user nova-compute[74261]: node.session.auth.username_in = <empty>
Oct 17 11:48:21 user nova-compute[74261]: node.session.auth.password_in = <empty>
Oct 17 11:48:21 user nova-compute[74261]: node.session.auth.chap_algs = MD5
Oct 17 11:48:21 user nova-compute[74261]: node.session.timeo.replacement_timeout = 120
Oct 17 11:48:21 user nova-compute[74261]: node.session.err_timeo.abort_timeout = 15
Oct 17 11:48:21 user nova-compute[74261]: node.session.err_timeo.lu_reset_timeout = 30
Oct 17 11:48:21 user nova-compute[74261]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 17 11:48:21 user nova-compute[74261]: node.session.err_timeo.host_reset_timeout = 60
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.FastAbort = Yes
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.InitialR2T = No
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.ImmediateData = Yes
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.FirstBurstLength = 262144
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.MaxBurstLength = 16776192
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.DefaultTime2Retain = 0
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.DefaultTime2Wait = 2
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.MaxConnections = 1
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 17 11:48:21 user nova-compute[74261]: node.session.iscsi.ERL = 0
Oct 17 11:48:21 user nova-compute[74261]: node.session.scan = manual
Oct 17 11:48:21 user nova-compute[74261]: node.session.reopen_max = 0
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].address = 172.16.0.220
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].port = 3260
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].startup = manual
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].tcp.window_size = 524288
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].tcp.type_of_service = 0
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].timeo.logout_timeout = 15
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].timeo.login_timeout = 15
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].timeo.auth_timeout = 45
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].timeo.noop_out_interval = 5
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].timeo.noop_out_timeout = 5
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].iscsi.HeaderDigest = None
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].iscsi.DataDigest = None
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].iscsi.IFMarker = No
Oct 17 11:48:21 user nova-compute[74261]: node.conn[0].iscsi.OFMarker = No
Oct 17 11:48:21 user nova-compute[74261]: # END RECORD
Oct 17 11:48:21 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b80ac-923a-4d12-b8c5-0af3db43df70]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776fc8c-82aa-436f-a0ec-7156be2fbf07]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsjmvIFg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsjmvIFg" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[15daf8b5-4f1e-47f5-9922-5a938b98592f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wsjmvIFg'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e43aed-d17a-4034-a7dd-47503418707c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2518335-2767-4cc5-99e5-7152468d523c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:21 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:21 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:21 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:21 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:21 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:21 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40178f9-f80d-4204-a2bd-2d0a26683ba7]: (4, ('0 0 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsjmvIFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] <== connect_volume: return (159ms) {'type': 'block', 'scsi_wwn': '23761633936643337', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761633936643337', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-103165328',display_name='tempest-ServerStableDeviceRescueTest-server-103165328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-103165328',id=4,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlEf7+UCLSnqPt4PKh90e106AvNKjFXQiuFNpfY7AvzpEigsAoqR2ZVklvDCW0gT2Po9SnkkBWVgCY3j/+bYFs8wuzd1kue6eGFu2ZmzTtUhUJm/SvDqwbrwYXwtBsatQ==',key_name='tempest-keypair-120172596',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d586c830e4974cb8b3fcb758675e7014',ramdisk_id='',reservation_id='r-495hwwnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-895463564',owner_user_name='tempest-ServerStableDeviceRescueTest-895463564-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68be85de4b2e4f4d8ac32f8e62abda04',uuid=f07110f1-a355-47f2-9243-620b6ca41584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "vif_mac": "fa:16:3e:38:0c:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converting VIF {"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "vif_mac": "fa:16:3e:38:0c:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'pci_devices' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.objects.base [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Object Instance<f07110f1-a355-47f2-9243-620b6ca41584> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:48:21 user nova-compute[74261]:   <uuid>f07110f1-a355-47f2-9243-620b6ca41584</uuid>
Oct 17 11:48:21 user nova-compute[74261]:   <name>instance-00000004</name>
Oct 17 11:48:21 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:48:21 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:48:21 user nova-compute[74261]:   <metadata>
Oct 17 11:48:21 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:48:21 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:48:21 user nova-compute[74261]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-103165328</nova:name>
Oct 17 11:48:21 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:48:21</nova:creationTime>
Oct 17 11:48:21 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:48:21 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:48:21 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:48:21 user nova-compute[74261]:       <nova:owner>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:user uuid="68be85de4b2e4f4d8ac32f8e62abda04">tempest-ServerStableDeviceRescueTest-895463564-project-member</nova:user>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:project uuid="d586c830e4974cb8b3fcb758675e7014">tempest-ServerStableDeviceRescueTest-895463564</nova:project>
Oct 17 11:48:21 user nova-compute[74261]:       </nova:owner>
Oct 17 11:48:21 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:48:21 user nova-compute[74261]:       <nova:ports>
Oct 17 11:48:21 user nova-compute[74261]:         <nova:port uuid="7f10f299-2636-4403-80bf-e128689cdc4e">
Oct 17 11:48:21 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:48:21 user nova-compute[74261]:         </nova:port>
Oct 17 11:48:21 user nova-compute[74261]:       </nova:ports>
Oct 17 11:48:21 user nova-compute[74261]:     </nova:instance>
Oct 17 11:48:21 user nova-compute[74261]:   </metadata>
Oct 17 11:48:21 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:48:21 user nova-compute[74261]:     <system>
Oct 17 11:48:21 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:48:21 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:48:21 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:48:21 user nova-compute[74261]:       <entry name="serial">f07110f1-a355-47f2-9243-620b6ca41584</entry>
Oct 17 11:48:21 user nova-compute[74261]:       <entry name="uuid">f07110f1-a355-47f2-9243-620b6ca41584</entry>
Oct 17 11:48:21 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:48:21 user nova-compute[74261]:     </system>
Oct 17 11:48:21 user nova-compute[74261]:   </sysinfo>
Oct 17 11:48:21 user nova-compute[74261]:   <os>
Oct 17 11:48:21 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:48:21 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:48:21 user nova-compute[74261]:   </os>
Oct 17 11:48:21 user nova-compute[74261]:   <features>
Oct 17 11:48:21 user nova-compute[74261]:     <acpi/>
Oct 17 11:48:21 user nova-compute[74261]:     <apic/>
Oct 17 11:48:21 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:48:21 user nova-compute[74261]:   </features>
Oct 17 11:48:21 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:48:21 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:48:21 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:48:21 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:48:21 user nova-compute[74261]:   </clock>
Oct 17 11:48:21 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:48:21 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:48:21 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:48:21 user nova-compute[74261]:   </cpu>
Oct 17 11:48:21 user nova-compute[74261]:   <devices>
Oct 17 11:48:21 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:48:21 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:48:21 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk"/>
Oct 17 11:48:21 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:48:21 user nova-compute[74261]:     </disk>
Oct 17 11:48:21 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:48:21 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:48:21 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 11:48:21 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:48:21 user nova-compute[74261]:       <serial>9e409f6a-94c2-4649-a458-7b85b4d00487</serial>
Oct 17 11:48:21 user nova-compute[74261]:     </disk>
Oct 17 11:48:21 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:48:21 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:48:21 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue"/>
Oct 17 11:48:21 user nova-compute[74261]:       <target dev="vdc" bus="virtio"/>
Oct 17 11:48:21 user nova-compute[74261]:       <boot order="1"/>
Oct 17 11:48:21 user nova-compute[74261]:     </disk>
Oct 17 11:48:21 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:48:21 user nova-compute[74261]:       <mac address="fa:16:3e:38:0c:0e"/>
Oct 17 11:48:21 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:48:21 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:48:21 user nova-compute[74261]:       <target dev="tap7f10f299-26"/>
Oct 17 11:48:21 user nova-compute[74261]:     </interface>
Oct 17 11:48:21 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:48:21 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/console.log" append="off"/>
Oct 17 11:48:21 user nova-compute[74261]:     </serial>
Oct 17 11:48:21 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:48:21 user nova-compute[74261]:     <video>
Oct 17 11:48:21 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:48:21 user nova-compute[74261]:     </video>
Oct 17 11:48:21 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:48:21 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:48:21 user nova-compute[74261]:     </rng>
Oct 17 11:48:21 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:48:21 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:48:21 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:48:21 user nova-compute[74261]:     </memballoon>
Oct 17 11:48:21 user nova-compute[74261]:   </devices>
Oct 17 11:48:21 user nova-compute[74261]: </domain>
Oct 17 11:48:21 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:48:21 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance destroyed successfully.
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:48:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] No VIF found with MAC fa:16:3e:38:0c:0e, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:48:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Instance spawned successfully.
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:48:22 user nova-compute[74261]: INFO nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Took 6.01 seconds to spawn the instance on the hypervisor.
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-e853bd27-9490-416e-b10a-ad9295ad5b22 req-5489e3b4-c23a-4fe2-bb13-3d21fd11b3fe service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e853bd27-9490-416e-b10a-ad9295ad5b22 req-5489e3b4-c23a-4fe2-bb13-3d21fd11b3fe service nova] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e853bd27-9490-416e-b10a-ad9295ad5b22 req-5489e3b4-c23a-4fe2-bb13-3d21fd11b3fe service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e853bd27-9490-416e-b10a-ad9295ad5b22 req-5489e3b4-c23a-4fe2-bb13-3d21fd11b3fe service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-e853bd27-9490-416e-b10a-ad9295ad5b22 req-5489e3b4-c23a-4fe2-bb13-3d21fd11b3fe service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] No waiting events found dispatching network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:22 user nova-compute[74261]: WARNING nova.compute.manager [req-e853bd27-9490-416e-b10a-ad9295ad5b22 req-5489e3b4-c23a-4fe2-bb13-3d21fd11b3fe service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received unexpected event network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 for instance with vm_state building and task_state spawning.
Oct 17 11:48:22 user nova-compute[74261]: INFO nova.compute.manager [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Took 7.09 seconds to build instance.
Oct 17 11:48:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-37558156-7f69-4b00-a24e-92c11a9c976e tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.206s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-b83d8b97-3d00-4821-9832-ddd4dd5ec766 req-8b1184e3-0107-4e3b-8fb5-ff953b81bfb3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b83d8b97-3d00-4821-9832-ddd4dd5ec766 req-8b1184e3-0107-4e3b-8fb5-ff953b81bfb3 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b83d8b97-3d00-4821-9832-ddd4dd5ec766 req-8b1184e3-0107-4e3b-8fb5-ff953b81bfb3 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b83d8b97-3d00-4821-9832-ddd4dd5ec766 req-8b1184e3-0107-4e3b-8fb5-ff953b81bfb3 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-b83d8b97-3d00-4821-9832-ddd4dd5ec766 req-8b1184e3-0107-4e3b-8fb5-ff953b81bfb3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:23 user nova-compute[74261]: WARNING nova.compute.manager [req-b83d8b97-3d00-4821-9832-ddd4dd5ec766 req-8b1184e3-0107-4e3b-8fb5-ff953b81bfb3 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state active and task_state rescuing.
Oct 17 11:48:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:24 user nova-compute[74261]: INFO nova.compute.manager [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Terminating instance
Oct 17 11:48:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-9ba5413a-fd16-48e4-bdf8-6ad33b545efb req-bc08d258-1701-48f3-9f3a-5016923b5ffd service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-unplugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9ba5413a-fd16-48e4-bdf8-6ad33b545efb req-bc08d258-1701-48f3-9f3a-5016923b5ffd service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9ba5413a-fd16-48e4-bdf8-6ad33b545efb req-bc08d258-1701-48f3-9f3a-5016923b5ffd service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9ba5413a-fd16-48e4-bdf8-6ad33b545efb req-bc08d258-1701-48f3-9f3a-5016923b5ffd service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-9ba5413a-fd16-48e4-bdf8-6ad33b545efb req-bc08d258-1701-48f3-9f3a-5016923b5ffd service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-unplugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-9ba5413a-fd16-48e4-bdf8-6ad33b545efb req-bc08d258-1701-48f3-9f3a-5016923b5ffd service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-unplugged-c52b809b-bc53-45bf-b53d-58b724efacf7 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Instance destroyed successfully.
Oct 17 11:48:24 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lazy-loading 'resources' on Instance uuid bfccfe8a-4414-44b0-9e94-12b6f7003406 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-318388657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-318388657',id=9,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0KOBvkNGktIFJAYezQilXIc3eCohwkYi+wOUjEQMcmKDEDBii5EFQvmPxQShCDbUSxJedct8GtHRZh2WNbTGaqXSR53W4nBxc/Kg/27xNWTGNEJ45Ic74D1C58dXi2Zg==',key_name='tempest-keypair-1272870301',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2b1386d00864d748f658ae72455d6fc',ramdisk_id='',reservation_id='r-fxa77jno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1458685808',owner_user_name='tempest-TaggedAttachmentsTest-1458685808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6a380973f1c4684b1dca8d8ec8de410',uuid=bfccfe8a-4414-44b0-9e94-12b6f7003406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converting VIF {"id": "c52b809b-bc53-45bf-b53d-58b724efacf7", "address": "fa:16:3e:44:d7:13", "network": {"id": "fa067cd6-5f95-4614-8a5b-c9262ee5a5b8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806324740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2b1386d00864d748f658ae72455d6fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52b809b-bc", "ovs_interfaceid": "c52b809b-bc53-45bf-b53d-58b724efacf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG os_vif [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc52b809b-bc, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b565976e-55fe-4dfc-a3cf-48f17c3a8b5e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: INFO os_vif [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=c52b809b-bc53-45bf-b53d-58b724efacf7,network=Network(fa067cd6-5f95-4614-8a5b-c9262ee5a5b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52b809b-bc')
Oct 17 11:48:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Deleting instance files /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406_del
Oct 17 11:48:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Deletion of /opt/stack/data/nova/instances/bfccfe8a-4414-44b0-9e94-12b6f7003406_del complete
Oct 17 11:48:25 user nova-compute[74261]: INFO nova.compute.manager [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 17 11:48:25 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-e3392d5d-5150-4929-a9b5-47459463e61d req-6884f9c8-ed82-4c66-a986-8de5ffdd7430 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e3392d5d-5150-4929-a9b5-47459463e61d req-6884f9c8-ed82-4c66-a986-8de5ffdd7430 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e3392d5d-5150-4929-a9b5-47459463e61d req-6884f9c8-ed82-4c66-a986-8de5ffdd7430 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e3392d5d-5150-4929-a9b5-47459463e61d req-6884f9c8-ed82-4c66-a986-8de5ffdd7430 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-e3392d5d-5150-4929-a9b5-47459463e61d req-6884f9c8-ed82-4c66-a986-8de5ffdd7430 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:25 user nova-compute[74261]: WARNING nova.compute.manager [req-e3392d5d-5150-4929-a9b5-47459463e61d req-6884f9c8-ed82-4c66-a986-8de5ffdd7430 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state active and task_state rescuing.
Oct 17 11:48:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-43c1eb5f-4fba-4cab-96ba-ca48239a793d tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:25 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Took 0.75 seconds to deallocate network for instance.
Oct 17 11:48:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:26 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Deleted allocations for instance bfccfe8a-4414-44b0-9e94-12b6f7003406
Oct 17 11:48:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a723836c-914b-4e9f-8360-258a642eb627 tempest-TaggedAttachmentsTest-1458685808 tempest-TaggedAttachmentsTest-1458685808-project-member] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-d64613b2-4565-4ecf-8eef-edeea6e09349 req-a6d303da-e123-4eb3-a842-2f6f6d4cbe01 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d64613b2-4565-4ecf-8eef-edeea6e09349 req-a6d303da-e123-4eb3-a842-2f6f6d4cbe01 service nova] Acquiring lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d64613b2-4565-4ecf-8eef-edeea6e09349 req-a6d303da-e123-4eb3-a842-2f6f6d4cbe01 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d64613b2-4565-4ecf-8eef-edeea6e09349 req-a6d303da-e123-4eb3-a842-2f6f6d4cbe01 service nova] Lock "bfccfe8a-4414-44b0-9e94-12b6f7003406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-d64613b2-4565-4ecf-8eef-edeea6e09349 req-a6d303da-e123-4eb3-a842-2f6f6d4cbe01 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] No waiting events found dispatching network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:26 user nova-compute[74261]: WARNING nova.compute.manager [req-d64613b2-4565-4ecf-8eef-edeea6e09349 req-a6d303da-e123-4eb3-a842-2f6f6d4cbe01 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received unexpected event network-vif-plugged-c52b809b-bc53-45bf-b53d-58b724efacf7 for instance with vm_state deleted and task_state None.
Oct 17 11:48:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-60b74197-3acd-416a-be1c-cc767f1c8417 req-b1d122c5-37d3-4402-82e4-e5fcda081477 service nova] [instance: bfccfe8a-4414-44b0-9e94-12b6f7003406] Received event network-vif-deleted-c52b809b-bc53-45bf-b53d-58b724efacf7 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:35 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d0bc8ec6-6f50-4013-a360-71c64069ed2f is timed out.
Oct 17 11:48:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Successfully detached device vdb from instance d0bc8ec6-6f50-4013-a360-71c64069ed2f from the live domain config.
Oct 17 11:48:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLbhCWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '731b9014-4c69-45bb-a259-af5e67f2a74c'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:48:35 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c38d81-e172-4896-ab55-94a2e12d3dab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:48:35 user nova-compute[74261]: No targets found.
Oct 17 11:48:35 user nova-compute[74261]: iSNS:
Oct 17 11:48:35 user nova-compute[74261]: No targets found.
Oct 17 11:48:35 user nova-compute[74261]: STATIC:
Oct 17 11:48:35 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c
Oct 17 11:48:35 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:48:35 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:48:35 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:48:35 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:48:35 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:48:35 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:48:35 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:48:35 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:48:35 user nova-compute[74261]: FIRMWARE:
Oct 17 11:48:35 user nova-compute[74261]: No targets found.
Oct 17 11:48:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:48:35 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:48:35 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb50eb67-4776-4543-968e-02d62c506c5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b44054-34f6-459e-ba50-a4b787e6ac2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:35 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:35 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:35 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:35 user nova-compute[74261]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c (non-flash)
Oct 17 11:48:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c4bb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1973e20b-bc20-41c1-877f-bd3fa4925a98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dfd67a-dbdd-4b7c-a6d2-01d919e9c6e8]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[534dce62-760c-44d2-9f7d-9fa3df658281]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87bda3-685a-458d-8b55-51e6cc1a5f80]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026b1e1-dcc9-4292-846b-6c42a07180f5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3dc65-eaef-40ca-a8bc-35e2dd784fdb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260]
Oct 17 11:48:36 user nova-compute[74261]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c, portal: 172.16.0.220,3260] successful.
Oct 17 11:48:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731b9014-4c69-45bb-a259-af5e67f2a74c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3df43-6a3a-4830-952d-97cb7f529dcd]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] <== disconnect_volume: return (401ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:48:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:48:37 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lazy-loading 'flavor' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ef-91bf-4f37-8c79-278e5ed44344 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.225s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:48:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:48:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:48:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'info_cache' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:47 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance destroyed successfully.
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'resources' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf15dff2-7d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=865d4a6c-e576-47fc-b021-fe4d24b5e36a) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:48 user nova-compute[74261]: INFO os_vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d')
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:48:48 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c1228-2c16-4c8d-a798-299c0bce0613]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:48:48 user nova-compute[74261]: No targets found.
Oct 17 11:48:48 user nova-compute[74261]: iSNS:
Oct 17 11:48:48 user nova-compute[74261]: No targets found.
Oct 17 11:48:48 user nova-compute[74261]: STATIC:
Oct 17 11:48:48 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:48:48 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:48:48 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:48:48 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:48:48 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:48:48 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:48:48 user nova-compute[74261]: FIRMWARE:
Oct 17 11:48:48 user nova-compute[74261]: No targets found.
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:48:48 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:48:48 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dbab23-e5c3-4f9e-a37c-7e112f061333]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb93e937-db07-4e99-bc6d-4cfeb105915e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:48 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:48 user nova-compute[74261]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2412d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab'): ({'sdd'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Removing single pathed devices sdd {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade4ce8-33de-459c-a87c-2c52be624cad]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeadb1a-5423-4e7c-acbd-fc5174d5e2a3]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flushing IO for device /dev/sdd {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92dccd-c45e-4728-993e-2d5c96296821]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1521c94-9201-4b2f-9179-9f9fb1ede164]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45ae56-cc19-45d1-9d7b-48371d3b4b83]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14bae0-0e83-41cc-96ba-77d7ed789dff]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]
Oct 17 11:48:48 user nova-compute[74261]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4edb63-fad5-4d5e-8609-e55899aed1e6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== disconnect_volume: return (287ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start _get_guest_xml network_info=[{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '7244a418-b6e5-454c-b1c5-2a8d67923bf8', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '93fe26e6-4a68-4976-b53c-3c33250c20de', 'attached_at': '', 'detached_at': '', 'volume_id': '404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'serial': '404c28d5-d363-40eb-8b0d-94ea33bf54ab'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'numa_topology' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:48 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:48 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:48:48 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:48 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:48:48 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83082e3-2466-401c-8c93-5cfa19ba9e13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:48:48 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca77b4-3f3a-44ad-9ca4-74185913c1fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab] added
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ac69a-5335-4178-a405-3614767a5235]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b846b6-e2fe-47ab-99f8-09dfdf49492b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DexHRSiB {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DexHRSiB" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e272d45d-e03d-4834-be31-bdd87fd7569e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DexHRSiB'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dffc384-849d-4dcb-9592-aebfaa703add]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3738c8-dd03-48ea-9876-f4b46bcefd7d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbcba18-49b0-4c22-89b2-f5c8c8c84ee2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]
Oct 17 11:48:48 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e450b-8b8d-4660-a307-f5b932402a80]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4b6ce0-182f-4e46-a550-f07cd9fbf680]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:48 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:48:48 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:48:48 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:48:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e692a3f-4e53-4302-a6b5-6c96db9562bd]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:48:49 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:48:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23333363231323263', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333363231323263', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'pci_devices' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:48:50 user nova-compute[74261]:   <uuid>93fe26e6-4a68-4976-b53c-3c33250c20de</uuid>
Oct 17 11:48:50 user nova-compute[74261]:   <name>instance-00000005</name>
Oct 17 11:48:50 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:48:50 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:48:50 user nova-compute[74261]:   <metadata>
Oct 17 11:48:50 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:48:50 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:48:50 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeTestJSON-server-1703914465</nova:name>
Oct 17 11:48:50 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:48:48</nova:creationTime>
Oct 17 11:48:50 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:48:50 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:48:50 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:48:50 user nova-compute[74261]:       <nova:owner>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:user uuid="0f0a17cbf46d422899c2dad6b8000fb3">tempest-AttachVolumeTestJSON-1691828841-project-member</nova:user>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:project uuid="743ac99ae6b44e43ab599e1731d79b3b">tempest-AttachVolumeTestJSON-1691828841</nova:project>
Oct 17 11:48:50 user nova-compute[74261]:       </nova:owner>
Oct 17 11:48:50 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:48:50 user nova-compute[74261]:       <nova:ports>
Oct 17 11:48:50 user nova-compute[74261]:         <nova:port uuid="af15dff2-7dd0-449e-9cfa-9ae2135a43d4">
Oct 17 11:48:50 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 11:48:50 user nova-compute[74261]:         </nova:port>
Oct 17 11:48:50 user nova-compute[74261]:       </nova:ports>
Oct 17 11:48:50 user nova-compute[74261]:     </nova:instance>
Oct 17 11:48:50 user nova-compute[74261]:   </metadata>
Oct 17 11:48:50 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:48:50 user nova-compute[74261]:     <system>
Oct 17 11:48:50 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:48:50 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:48:50 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:48:50 user nova-compute[74261]:       <entry name="serial">93fe26e6-4a68-4976-b53c-3c33250c20de</entry>
Oct 17 11:48:50 user nova-compute[74261]:       <entry name="uuid">93fe26e6-4a68-4976-b53c-3c33250c20de</entry>
Oct 17 11:48:50 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:48:50 user nova-compute[74261]:     </system>
Oct 17 11:48:50 user nova-compute[74261]:   </sysinfo>
Oct 17 11:48:50 user nova-compute[74261]:   <os>
Oct 17 11:48:50 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:48:50 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:48:50 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:48:50 user nova-compute[74261]:   </os>
Oct 17 11:48:50 user nova-compute[74261]:   <features>
Oct 17 11:48:50 user nova-compute[74261]:     <acpi/>
Oct 17 11:48:50 user nova-compute[74261]:     <apic/>
Oct 17 11:48:50 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:48:50 user nova-compute[74261]:   </features>
Oct 17 11:48:50 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:48:50 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:48:50 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:48:50 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:48:50 user nova-compute[74261]:   </clock>
Oct 17 11:48:50 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:48:50 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:48:50 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:48:50 user nova-compute[74261]:   </cpu>
Oct 17 11:48:50 user nova-compute[74261]:   <devices>
Oct 17 11:48:50 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:48:50 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:48:50 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk"/>
Oct 17 11:48:50 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:48:50 user nova-compute[74261]:     </disk>
Oct 17 11:48:50 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:48:50 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:48:50 user nova-compute[74261]:       <source dev="/dev/sdc"/>
Oct 17 11:48:50 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:48:50 user nova-compute[74261]:       <serial>404c28d5-d363-40eb-8b0d-94ea33bf54ab</serial>
Oct 17 11:48:50 user nova-compute[74261]:     </disk>
Oct 17 11:48:50 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:48:50 user nova-compute[74261]:       <mac address="fa:16:3e:83:f7:64"/>
Oct 17 11:48:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:48:50 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:48:50 user nova-compute[74261]:       <target dev="tapaf15dff2-7d"/>
Oct 17 11:48:50 user nova-compute[74261]:     </interface>
Oct 17 11:48:50 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:48:50 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/console.log" append="off"/>
Oct 17 11:48:50 user nova-compute[74261]:     </serial>
Oct 17 11:48:50 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:48:50 user nova-compute[74261]:     <video>
Oct 17 11:48:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:48:50 user nova-compute[74261]:     </video>
Oct 17 11:48:50 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:48:50 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:48:50 user nova-compute[74261]:     </rng>
Oct 17 11:48:50 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:48:50 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:48:50 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:48:50 user nova-compute[74261]:     </memballoon>
Oct 17 11:48:50 user nova-compute[74261]:   </devices>
Oct 17 11:48:50 user nova-compute[74261]: </domain>
Oct 17 11:48:50 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Cannot resize image /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'migration_context' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.objects.base [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG os_vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '645fa193-3a41-5ffd-8cc3-6602159c63d6', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf15dff2-7d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf15dff2-7d, col_values=(('qos', UUID('bb898c14-53af-40d4-8946-a407625f1e1d')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf15dff2-7d, col_values=(('external_ids', {'iface-id': 'af15dff2-7dd0-449e-9cfa-9ae2135a43d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:f7:64', 'vm-uuid': '93fe26e6-4a68-4976-b53c-3c33250c20de'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:48:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:51 user nova-compute[74261]: INFO os_vif [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d')
Oct 17 11:48:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-a8ae94a6-1588-4baa-a46c-d297d4e84745 req-17460c14-4531-4d20-b00f-9965a5ee4a47 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a8ae94a6-1588-4baa-a46c-d297d4e84745 req-17460c14-4531-4d20-b00f-9965a5ee4a47 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a8ae94a6-1588-4baa-a46c-d297d4e84745 req-17460c14-4531-4d20-b00f-9965a5ee4a47 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a8ae94a6-1588-4baa-a46c-d297d4e84745 req-17460c14-4531-4d20-b00f-9965a5ee4a47 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-a8ae94a6-1588-4baa-a46c-d297d4e84745 req-17460c14-4531-4d20-b00f-9965a5ee4a47 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:52 user nova-compute[74261]: WARNING nova.compute.manager [req-a8ae94a6-1588-4baa-a46c-d297d4e84745 req-17460c14-4531-4d20-b00f-9965a5ee4a47 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state stopped and task_state powering-on.
Oct 17 11:48:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:48:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance rebooted successfully.
Oct 17 11:48:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c07f416b-89d1-4b36-9801-2393ac90a308 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:48:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-cea12796-06e7-40a7-84c0-ef4adc031c7f req-f4cd62bb-80db-4937-9a83-995b1d300b45 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:48:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cea12796-06e7-40a7-84c0-ef4adc031c7f req-f4cd62bb-80db-4937-9a83-995b1d300b45 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cea12796-06e7-40a7-84c0-ef4adc031c7f req-f4cd62bb-80db-4937-9a83-995b1d300b45 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cea12796-06e7-40a7-84c0-ef4adc031c7f req-f4cd62bb-80db-4937-9a83-995b1d300b45 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-cea12796-06e7-40a7-84c0-ef4adc031c7f req-f4cd62bb-80db-4937-9a83-995b1d300b45 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:48:54 user nova-compute[74261]: WARNING nova.compute.manager [req-cea12796-06e7-40a7-84c0-ef4adc031c7f req-f4cd62bb-80db-4937-9a83-995b1d300b45 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state active and task_state None.
Oct 17 11:48:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:48:59 user nova-compute[74261]: INFO nova.compute.claims [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Claim successful on node user
Oct 17 11:48:59 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:48:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:49:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:49:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Creating image(s)
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.policy [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '171d1037b5b74e09812373e40ef7c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0a71e6e0274702b67351ba09b91c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.254s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk 1073741824" returned: 0 in 0.071s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:49:00 user nova-compute[74261]: INFO nova.compute.claims [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Claim successful on node user
Oct 17 11:49:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.212s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Successfully created port: 03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Cannot resize image /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Ensure instance console log exists: /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:49:01 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.policy [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '171d1037b5b74e09812373e40ef7c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0a71e6e0274702b67351ba09b91c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:49:01 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Creating image(s)
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Successfully updated port: 03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-changed-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Refreshing instance network info cache due to event network-changed-03525b1a-3365-4e16-a0f9-254421d22c50. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG nova.network.neutron [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Refreshing network info cache for port 03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk 1073741824" returned: 0 in 0.062s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Successfully created port: 5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-646000e1-cdda-4eda-9696-81ff522b3a78 req-7f4bc71c-315f-453a-89e8-85e0797e2f78 service nova] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Cannot resize image /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Ensure instance console log exists: /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Successfully updated port: 5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-changed-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Refreshing instance network info cache due to event network-changed-5c6fdc01-fdc1-486e-8e4f-f639d75dee12. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:49:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] Acquiring lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance network_info: |[{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Start _get_guest_xml network_info=[{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:49:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-108849629',display_name='tempest-ServerRescueNegativeTestJSON-server-108849629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-108849629',id=16,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-1l47gkmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:00Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=dac3f877-dbbe-4593-b1a8-4c13b7c3382e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'pci_devices' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:49:03 user nova-compute[74261]:   <uuid>dac3f877-dbbe-4593-b1a8-4c13b7c3382e</uuid>
Oct 17 11:49:03 user nova-compute[74261]:   <name>instance-00000010</name>
Oct 17 11:49:03 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:49:03 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:49:03 user nova-compute[74261]:   <metadata>
Oct 17 11:49:03 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:49:03 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-108849629</nova:name>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:49:03</nova:creationTime>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:49:03 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:49:03 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:owner>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:user uuid="171d1037b5b74e09812373e40ef7c193">tempest-ServerRescueNegativeTestJSON-1673978463-project-member</nova:user>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:project uuid="ed0a71e6e0274702b67351ba09b91c7f">tempest-ServerRescueNegativeTestJSON-1673978463</nova:project>
Oct 17 11:49:03 user nova-compute[74261]:       </nova:owner>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:ports>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:port uuid="03525b1a-3365-4e16-a0f9-254421d22c50">
Oct 17 11:49:03 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 11:49:03 user nova-compute[74261]:         </nova:port>
Oct 17 11:49:03 user nova-compute[74261]:       </nova:ports>
Oct 17 11:49:03 user nova-compute[74261]:     </nova:instance>
Oct 17 11:49:03 user nova-compute[74261]:   </metadata>
Oct 17 11:49:03 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:49:03 user nova-compute[74261]:     <system>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="serial">dac3f877-dbbe-4593-b1a8-4c13b7c3382e</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="uuid">dac3f877-dbbe-4593-b1a8-4c13b7c3382e</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:49:03 user nova-compute[74261]:     </system>
Oct 17 11:49:03 user nova-compute[74261]:   </sysinfo>
Oct 17 11:49:03 user nova-compute[74261]:   <os>
Oct 17 11:49:03 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:49:03 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:49:03 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:49:03 user nova-compute[74261]:   </os>
Oct 17 11:49:03 user nova-compute[74261]:   <features>
Oct 17 11:49:03 user nova-compute[74261]:     <acpi/>
Oct 17 11:49:03 user nova-compute[74261]:     <apic/>
Oct 17 11:49:03 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:49:03 user nova-compute[74261]:   </features>
Oct 17 11:49:03 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:49:03 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:49:03 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:49:03 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:49:03 user nova-compute[74261]:   </clock>
Oct 17 11:49:03 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:49:03 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:49:03 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:49:03 user nova-compute[74261]:   </cpu>
Oct 17 11:49:03 user nova-compute[74261]:   <devices>
Oct 17 11:49:03 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:49:03 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:49:03 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk"/>
Oct 17 11:49:03 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:49:03 user nova-compute[74261]:     </disk>
Oct 17 11:49:03 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:49:03 user nova-compute[74261]:       <mac address="fa:16:3e:6e:2b:3d"/>
Oct 17 11:49:03 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:49:03 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:49:03 user nova-compute[74261]:       <target dev="tap03525b1a-33"/>
Oct 17 11:49:03 user nova-compute[74261]:     </interface>
Oct 17 11:49:03 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:49:03 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/console.log" append="off"/>
Oct 17 11:49:03 user nova-compute[74261]:     </serial>
Oct 17 11:49:03 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:49:03 user nova-compute[74261]:     <video>
Oct 17 11:49:03 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:49:03 user nova-compute[74261]:     </video>
Oct 17 11:49:03 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:49:03 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:49:03 user nova-compute[74261]:     </rng>
Oct 17 11:49:03 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:49:03 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:49:03 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:49:03 user nova-compute[74261]:     </memballoon>
Oct 17 11:49:03 user nova-compute[74261]:   </devices>
Oct 17 11:49:03 user nova-compute[74261]: </domain>
Oct 17 11:49:03 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-108849629',display_name='tempest-ServerRescueNegativeTestJSON-server-108849629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-108849629',id=16,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-1l47gkmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:00Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=dac3f877-dbbe-4593-b1a8-4c13b7c3382e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG os_vif [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29d5ca43-cb47-5527-944c-388c8113812e', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03525b1a-33, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03525b1a-33, col_values=(('qos', UUID('bd5e0591-f843-4886-9ea6-9879db1852f5')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03525b1a-33, col_values=(('external_ids', {'iface-id': '03525b1a-3365-4e16-a0f9-254421d22c50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2b:3d', 'vm-uuid': 'dac3f877-dbbe-4593-b1a8-4c13b7c3382e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: INFO os_vif [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33')
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:6e:2b:3d, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updating instance_info_cache with network_info: [{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance network_info: |[{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] Acquired lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Refreshing network info cache for port 5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Start _get_guest_xml network_info=[{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:49:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132186004',display_name='tempest-ServerRescueNegativeTestJSON-server-1132186004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132186004',id=17,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-4ah40h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:02Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=a590a88c-15ce-478b-976d-7e1828eee2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.objects.instance [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'pci_devices' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:49:03 user nova-compute[74261]:   <uuid>a590a88c-15ce-478b-976d-7e1828eee2bf</uuid>
Oct 17 11:49:03 user nova-compute[74261]:   <name>instance-00000011</name>
Oct 17 11:49:03 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:49:03 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:49:03 user nova-compute[74261]:   <metadata>
Oct 17 11:49:03 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:49:03 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1132186004</nova:name>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:49:03</nova:creationTime>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:49:03 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:49:03 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:owner>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:user uuid="171d1037b5b74e09812373e40ef7c193">tempest-ServerRescueNegativeTestJSON-1673978463-project-member</nova:user>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:project uuid="ed0a71e6e0274702b67351ba09b91c7f">tempest-ServerRescueNegativeTestJSON-1673978463</nova:project>
Oct 17 11:49:03 user nova-compute[74261]:       </nova:owner>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:49:03 user nova-compute[74261]:       <nova:ports>
Oct 17 11:49:03 user nova-compute[74261]:         <nova:port uuid="5c6fdc01-fdc1-486e-8e4f-f639d75dee12">
Oct 17 11:49:03 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 11:49:03 user nova-compute[74261]:         </nova:port>
Oct 17 11:49:03 user nova-compute[74261]:       </nova:ports>
Oct 17 11:49:03 user nova-compute[74261]:     </nova:instance>
Oct 17 11:49:03 user nova-compute[74261]:   </metadata>
Oct 17 11:49:03 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:49:03 user nova-compute[74261]:     <system>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="serial">a590a88c-15ce-478b-976d-7e1828eee2bf</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="uuid">a590a88c-15ce-478b-976d-7e1828eee2bf</entry>
Oct 17 11:49:03 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:49:03 user nova-compute[74261]:     </system>
Oct 17 11:49:03 user nova-compute[74261]:   </sysinfo>
Oct 17 11:49:03 user nova-compute[74261]:   <os>
Oct 17 11:49:03 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:49:03 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:49:03 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:49:03 user nova-compute[74261]:   </os>
Oct 17 11:49:03 user nova-compute[74261]:   <features>
Oct 17 11:49:03 user nova-compute[74261]:     <acpi/>
Oct 17 11:49:03 user nova-compute[74261]:     <apic/>
Oct 17 11:49:03 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:49:03 user nova-compute[74261]:   </features>
Oct 17 11:49:03 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:49:03 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:49:03 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:49:03 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:49:03 user nova-compute[74261]:   </clock>
Oct 17 11:49:03 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:49:03 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:49:03 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:49:03 user nova-compute[74261]:   </cpu>
Oct 17 11:49:03 user nova-compute[74261]:   <devices>
Oct 17 11:49:03 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:49:03 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:49:03 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk"/>
Oct 17 11:49:03 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:49:03 user nova-compute[74261]:     </disk>
Oct 17 11:49:03 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:49:03 user nova-compute[74261]:       <mac address="fa:16:3e:c3:42:eb"/>
Oct 17 11:49:03 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:49:03 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:49:03 user nova-compute[74261]:       <target dev="tap5c6fdc01-fd"/>
Oct 17 11:49:03 user nova-compute[74261]:     </interface>
Oct 17 11:49:03 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:49:03 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/console.log" append="off"/>
Oct 17 11:49:03 user nova-compute[74261]:     </serial>
Oct 17 11:49:03 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:49:03 user nova-compute[74261]:     <video>
Oct 17 11:49:03 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:49:03 user nova-compute[74261]:     </video>
Oct 17 11:49:03 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:49:03 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:49:03 user nova-compute[74261]:     </rng>
Oct 17 11:49:03 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:49:03 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:49:03 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:49:03 user nova-compute[74261]:     </memballoon>
Oct 17 11:49:03 user nova-compute[74261]:   </devices>
Oct 17 11:49:03 user nova-compute[74261]: </domain>
Oct 17 11:49:03 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132186004',display_name='tempest-ServerRescueNegativeTestJSON-server-1132186004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132186004',id=17,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-4ah40h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:02Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=a590a88c-15ce-478b-976d-7e1828eee2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG os_vif [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1c3f9a6-43ba-5ac3-987c-5a799cb7ab53', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c6fdc01-fd, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c6fdc01-fd, col_values=(('qos', UUID('dad76601-9984-4969-a46c-69782344a8d5')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c6fdc01-fd, col_values=(('external_ids', {'iface-id': '5c6fdc01-fdc1-486e-8e4f-f639d75dee12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:42:eb', 'vm-uuid': 'a590a88c-15ce-478b-976d-7e1828eee2bf'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:03 user nova-compute[74261]: INFO os_vif [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd')
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:49:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:c3:42:eb, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:49:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updated VIF entry in instance network info cache for port 5c6fdc01-fdc1-486e-8e4f-f639d75dee12. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:49:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updating instance_info_cache with network_info: [{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-268fbccc-ebe5-4ca6-8937-4e4a59e83960 req-69aba6ef-53c9-4486-a6e7-ea2c5f831cb9 service nova] Releasing lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:05 user nova-compute[74261]: INFO nova.compute.manager [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Terminating instance
Oct 17 11:49:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-3753a32f-fd67-4add-8f2a-139baa7e3863 req-e09c6ee1-31aa-4a9d-937b-1456de4d8381 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-vif-unplugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3753a32f-fd67-4add-8f2a-139baa7e3863 req-e09c6ee1-31aa-4a9d-937b-1456de4d8381 service nova] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3753a32f-fd67-4add-8f2a-139baa7e3863 req-e09c6ee1-31aa-4a9d-937b-1456de4d8381 service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3753a32f-fd67-4add-8f2a-139baa7e3863 req-e09c6ee1-31aa-4a9d-937b-1456de4d8381 service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-3753a32f-fd67-4add-8f2a-139baa7e3863 req-e09c6ee1-31aa-4a9d-937b-1456de4d8381 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] No waiting events found dispatching network-vif-unplugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-3753a32f-fd67-4add-8f2a-139baa7e3863 req-e09c6ee1-31aa-4a9d-937b-1456de4d8381 service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-vif-unplugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-c3fe6ed5-5f57-4732-be22-373f60171468 req-805b7c66-2026-4fb0-9afe-4dda4919ef53 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c3fe6ed5-5f57-4732-be22-373f60171468 req-805b7c66-2026-4fb0-9afe-4dda4919ef53 service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c3fe6ed5-5f57-4732-be22-373f60171468 req-805b7c66-2026-4fb0-9afe-4dda4919ef53 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c3fe6ed5-5f57-4732-be22-373f60171468 req-805b7c66-2026-4fb0-9afe-4dda4919ef53 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-c3fe6ed5-5f57-4732-be22-373f60171468 req-805b7c66-2026-4fb0-9afe-4dda4919ef53 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:06 user nova-compute[74261]: WARNING nova.compute.manager [req-c3fe6ed5-5f57-4732-be22-373f60171468 req-805b7c66-2026-4fb0-9afe-4dda4919ef53 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state building and task_state spawning.
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Instance destroyed successfully.
Oct 17 11:49:07 user nova-compute[74261]: DEBUG nova.objects.instance [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lazy-loading 'resources' on Instance uuid d0bc8ec6-6f50-4013-a360-71c64069ed2f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1570921175',display_name='tempest-TestVolumeSwap-server-1570921175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1570921175',id=10,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+L4cAY2XKAQyuODf1b88yuRhiKFwfXRqRE/bG3QpQqU8+pZsybpy/unbzBpwr0wHJLSiRhX0S9ObEQc+hkKTQEfXD+lZ7X8TH4aRQ54XaOf6kO1kR0nX4izggoUvl3+g==',key_name='tempest-keypair-608785386',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5522812b0714ec4896a140ad12be9d2',ramdisk_id='',reservation_id='r-1rvqmtni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2127134927',owner_user_name='tempest-TestVolumeSwap-2127134927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='717ab8583e0e4d66b9e834c0299ea775',uuid=d0bc8ec6-6f50-4013-a360-71c64069ed2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Converting VIF {"id": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "address": "fa:16:3e:f6:69:19", "network": {"id": "1a886a3b-5273-4ee6-b20f-b4cc16df06f0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-227988736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5522812b0714ec4896a140ad12be9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1774a9a4-4e", "ovs_interfaceid": "1774a9a4-4e0b-473a-9c1d-cc03100e96b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG os_vif [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1774a9a4-4e, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b75d7abd-68c2-4ff6-b7e2-21ae2a958f3e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:07 user nova-compute[74261]: INFO os_vif [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:69:19,bridge_name='br-int',has_traffic_filtering=True,id=1774a9a4-4e0b-473a-9c1d-cc03100e96b4,network=Network(1a886a3b-5273-4ee6-b20f-b4cc16df06f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1774a9a4-4e')
Oct 17 11:49:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Deleting instance files /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f_del
Oct 17 11:49:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Deletion of /opt/stack/data/nova/instances/d0bc8ec6-6f50-4013-a360-71c64069ed2f_del complete
Oct 17 11:49:07 user nova-compute[74261]: INFO nova.compute.manager [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Took 1.85 seconds to destroy the instance on the hypervisor.
Oct 17 11:49:07 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:49:07 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Acquiring lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] No waiting events found dispatching network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:08 user nova-compute[74261]: WARNING nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received unexpected event network-vif-plugged-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 for instance with vm_state active and task_state deleting.
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:08 user nova-compute[74261]: WARNING nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state building and task_state spawning.
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:08 user nova-compute[74261]: WARNING nova.compute.manager [req-5b22fbf8-2142-497c-8ef0-7f7bf77aec0e req-3ce42b24-51af-4799-b26c-0ff780ceddac service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state building and task_state spawning.
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-9b2c9ec0-96c3-400b-8790-0855a2cc2db0 req-35835bc9-0361-4335-98ac-5ff38561ae6e service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9b2c9ec0-96c3-400b-8790-0855a2cc2db0 req-35835bc9-0361-4335-98ac-5ff38561ae6e service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9b2c9ec0-96c3-400b-8790-0855a2cc2db0 req-35835bc9-0361-4335-98ac-5ff38561ae6e service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9b2c9ec0-96c3-400b-8790-0855a2cc2db0 req-35835bc9-0361-4335-98ac-5ff38561ae6e service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-9b2c9ec0-96c3-400b-8790-0855a2cc2db0 req-35835bc9-0361-4335-98ac-5ff38561ae6e service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:08 user nova-compute[74261]: WARNING nova.compute.manager [req-9b2c9ec0-96c3-400b-8790-0855a2cc2db0 req-35835bc9-0361-4335-98ac-5ff38561ae6e service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state building and task_state spawning.
Oct 17 11:49:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance spawned successfully.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Took 2.27 seconds to deallocate network for instance.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Took 9.35 seconds to spawn the instance on the hypervisor.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance spawned successfully.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.compute.manager [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Took 10.28 seconds to build instance.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c37cdfa9-3d55-410a-82a9-bec6a1dc1702 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.404s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Took 8.07 seconds to spawn the instance on the hypervisor.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:49:09 user nova-compute[74261]: INFO nova.compute.manager [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Took 9.10 seconds to build instance.
Oct 17 11:49:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-101cde05-3317-451e-8759-c69699eaa7a4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.285s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-11fbbe27-1358-4af0-a46a-a29e3ddfece0 req-52ea8bd7-eb20-46ab-9e70-e2843e88867d service nova] [instance: d0bc8ec6-6f50-4013-a360-71c64069ed2f] Received event network-vif-deleted-1774a9a4-4e0b-473a-9c1d-cc03100e96b4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.642s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:10 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Deleted allocations for instance d0bc8ec6-6f50-4013-a360-71c64069ed2f
Oct 17 11:49:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-78e87566-6ec1-458b-9c98-b3a4333c45e8 tempest-TestVolumeSwap-2127134927 tempest-TestVolumeSwap-2127134927-project-member] Lock "d0bc8ec6-6f50-4013-a360-71c64069ed2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.062s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:49:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:49:14 user nova-compute[74261]: INFO nova.compute.claims [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Claim successful on node user
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json" returned: 0 in 0.294s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:49:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:49:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Creating image(s)
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "e45af1f64a6453ee475d527f2e37b772b9a793ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "e45af1f64a6453ee475d527f2e37b772b9a793ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG nova.policy [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bfbfaa0fb2f4f7fbcdd7f8b98d784f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0813d99c95c47adb2b92394341409e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:49:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.part --force-share --output=json" returned: 0 in 0.236s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG nova.virt.images [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] 09bedbee-5fc2-43c9-ab9e-42698c7b6c68 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.part /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.part /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.converted" returned: 0 in 0.262s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "e45af1f64a6453ee475d527f2e37b772b9a793ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.234s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "e45af1f64a6453ee475d527f2e37b772b9a793ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "e45af1f64a6453ee475d527f2e37b772b9a793ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed,backing_fmt=raw /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed,backing_fmt=raw /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk 1073741824" returned: 0 in 0.079s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "e45af1f64a6453ee475d527f2e37b772b9a793ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Cannot resize image /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Ensure instance console log exists: /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Successfully created port: 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:49:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.402s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7527MB free_disk=25.479961395263672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 68fa8b56-a6bb-4201-b1b0-29d50408673e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a8ffb39b-874a-484d-9171-293bf5245fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0b77d95-170b-40bb-9336-3c0afa66e1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Successfully updated port: 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-changed-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing instance network info cache due to event network-changed-56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance network_info: |[{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.neutron [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing network info cache for port 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Start _get_guest_xml network_info=[{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:49:10Z,direct_url=<?>,disk_format='qcow2',id=09bedbee-5fc2-43c9-ab9e-42698c7b6c68,min_disk=0,min_ram=0,name='tempest-scenario-img--510291031',owner='f0813d99c95c47adb2b92394341409e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:49:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '09bedbee-5fc2-43c9-ab9e-42698c7b6c68'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:49:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:49:10Z,direct_url=<?>,disk_format='qcow2',id=09bedbee-5fc2-43c9-ab9e-42698c7b6c68,min_disk=0,min_ram=0,name='tempest-scenario-img--510291031',owner='f0813d99c95c47adb2b92394341409e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:49:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-660772241',display_name='tempest-TestMinimumBasicScenario-server-660772241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-660772241',id=18,image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvoviKmRIWLhqx1/0v54FSfhcp38or1tfFwWW/M7aAdE030sOCxjF+2q5LfNWRzejEDrBKjI2pSldCHUoHdnMS81oeOCXOZ514/oXtGkD5pZKslf2vHEGeAmqjHXeQE0w==',key_name='tempest-TestMinimumBasicScenario-139334831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-8ku7ekcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:15Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=f0b77d95-170b-40bb-9336-3c0afa66e1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'pci_devices' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:49:18 user nova-compute[74261]:   <uuid>f0b77d95-170b-40bb-9336-3c0afa66e1df</uuid>
Oct 17 11:49:18 user nova-compute[74261]:   <name>instance-00000012</name>
Oct 17 11:49:18 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:49:18 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:49:18 user nova-compute[74261]:   <metadata>
Oct 17 11:49:18 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:49:18 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:49:18 user nova-compute[74261]:       <nova:name>tempest-TestMinimumBasicScenario-server-660772241</nova:name>
Oct 17 11:49:18 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:49:18</nova:creationTime>
Oct 17 11:49:18 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:49:18 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:49:18 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:49:18 user nova-compute[74261]:       <nova:owner>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:user uuid="4bfbfaa0fb2f4f7fbcdd7f8b98d784f9">tempest-TestMinimumBasicScenario-1183526091-project-member</nova:user>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:project uuid="f0813d99c95c47adb2b92394341409e8">tempest-TestMinimumBasicScenario-1183526091</nova:project>
Oct 17 11:49:18 user nova-compute[74261]:       </nova:owner>
Oct 17 11:49:18 user nova-compute[74261]:       <nova:root type="image" uuid="09bedbee-5fc2-43c9-ab9e-42698c7b6c68"/>
Oct 17 11:49:18 user nova-compute[74261]:       <nova:ports>
Oct 17 11:49:18 user nova-compute[74261]:         <nova:port uuid="56109d31-799c-49e5-8609-5455df819324">
Oct 17 11:49:18 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 17 11:49:18 user nova-compute[74261]:         </nova:port>
Oct 17 11:49:18 user nova-compute[74261]:       </nova:ports>
Oct 17 11:49:18 user nova-compute[74261]:     </nova:instance>
Oct 17 11:49:18 user nova-compute[74261]:   </metadata>
Oct 17 11:49:18 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:49:18 user nova-compute[74261]:     <system>
Oct 17 11:49:18 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:49:18 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:49:18 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:49:18 user nova-compute[74261]:       <entry name="serial">f0b77d95-170b-40bb-9336-3c0afa66e1df</entry>
Oct 17 11:49:18 user nova-compute[74261]:       <entry name="uuid">f0b77d95-170b-40bb-9336-3c0afa66e1df</entry>
Oct 17 11:49:18 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:49:18 user nova-compute[74261]:     </system>
Oct 17 11:49:18 user nova-compute[74261]:   </sysinfo>
Oct 17 11:49:18 user nova-compute[74261]:   <os>
Oct 17 11:49:18 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:49:18 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:49:18 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:49:18 user nova-compute[74261]:   </os>
Oct 17 11:49:18 user nova-compute[74261]:   <features>
Oct 17 11:49:18 user nova-compute[74261]:     <acpi/>
Oct 17 11:49:18 user nova-compute[74261]:     <apic/>
Oct 17 11:49:18 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:49:18 user nova-compute[74261]:   </features>
Oct 17 11:49:18 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:49:18 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:49:18 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:49:18 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:49:18 user nova-compute[74261]:   </clock>
Oct 17 11:49:18 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:49:18 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:49:18 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:49:18 user nova-compute[74261]:   </cpu>
Oct 17 11:49:18 user nova-compute[74261]:   <devices>
Oct 17 11:49:18 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:49:18 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:49:18 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk"/>
Oct 17 11:49:18 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:49:18 user nova-compute[74261]:     </disk>
Oct 17 11:49:18 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:49:18 user nova-compute[74261]:       <mac address="fa:16:3e:12:7a:2d"/>
Oct 17 11:49:18 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:49:18 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:49:18 user nova-compute[74261]:       <target dev="tap56109d31-79"/>
Oct 17 11:49:18 user nova-compute[74261]:     </interface>
Oct 17 11:49:18 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:49:18 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/console.log" append="off"/>
Oct 17 11:49:18 user nova-compute[74261]:     </serial>
Oct 17 11:49:18 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:49:18 user nova-compute[74261]:     <video>
Oct 17 11:49:18 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:49:18 user nova-compute[74261]:     </video>
Oct 17 11:49:18 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:49:18 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:49:18 user nova-compute[74261]:     </rng>
Oct 17 11:49:18 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:49:18 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:49:18 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:49:18 user nova-compute[74261]:     </memballoon>
Oct 17 11:49:18 user nova-compute[74261]:   </devices>
Oct 17 11:49:18 user nova-compute[74261]: </domain>
Oct 17 11:49:18 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-660772241',display_name='tempest-TestMinimumBasicScenario-server-660772241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-660772241',id=18,image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvoviKmRIWLhqx1/0v54FSfhcp38or1tfFwWW/M7aAdE030sOCxjF+2q5LfNWRzejEDrBKjI2pSldCHUoHdnMS81oeOCXOZ514/oXtGkD5pZKslf2vHEGeAmqjHXeQE0w==',key_name='tempest-TestMinimumBasicScenario-139334831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-8ku7ekcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:15Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=f0b77d95-170b-40bb-9336-3c0afa66e1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG os_vif [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ffcbfcf-30ba-56f4-9c87-279f52fbad1e', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56109d31-79, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56109d31-79, col_values=(('qos', UUID('dcde6547-986f-45cf-992a-ee8be2d1caaa')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56109d31-79, col_values=(('external_ids', {'iface-id': '56109d31-799c-49e5-8609-5455df819324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:7a:2d', 'vm-uuid': 'f0b77d95-170b-40bb-9336-3c0afa66e1df'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:18 user nova-compute[74261]: INFO os_vif [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79')
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:49:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No VIF found with MAC fa:16:3e:12:7a:2d, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:49:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updated VIF entry in instance network info cache for port 56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:49:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0d2db184-316c-41ca-9e21-d4ade5bd2cc4 req-9a1cffb1-d4c2-4296-9903-7bc24845ea5d service nova] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-3190c89d-83bd-4f80-bf52-e6b5c7c8a285 req-afed1473-99ee-4e29-9a2c-1b62631090cd service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3190c89d-83bd-4f80-bf52-e6b5c7c8a285 req-afed1473-99ee-4e29-9a2c-1b62631090cd service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3190c89d-83bd-4f80-bf52-e6b5c7c8a285 req-afed1473-99ee-4e29-9a2c-1b62631090cd service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3190c89d-83bd-4f80-bf52-e6b5c7c8a285 req-afed1473-99ee-4e29-9a2c-1b62631090cd service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-3190c89d-83bd-4f80-bf52-e6b5c7c8a285 req-afed1473-99ee-4e29-9a2c-1b62631090cd service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:20 user nova-compute[74261]: WARNING nova.compute.manager [req-3190c89d-83bd-4f80-bf52-e6b5c7c8a285 req-afed1473-99ee-4e29-9a2c-1b62631090cd service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state building and task_state spawning.
Oct 17 11:49:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:49:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance spawned successfully.
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:49:22 user nova-compute[74261]: INFO nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Took 7.44 seconds to spawn the instance on the hypervisor.
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:49:22 user nova-compute[74261]: INFO nova.compute.manager [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Took 8.65 seconds to build instance.
Oct 17 11:49:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8b773256-9775-4ad6-ac25-db9ea1bdca78 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.799s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-2630b982-385e-4bf8-b760-8d9ed094a1c0 req-2ebf7acb-7ee9-435d-af28-1a663d2d1f47 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2630b982-385e-4bf8-b760-8d9ed094a1c0 req-2ebf7acb-7ee9-435d-af28-1a663d2d1f47 service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2630b982-385e-4bf8-b760-8d9ed094a1c0 req-2ebf7acb-7ee9-435d-af28-1a663d2d1f47 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2630b982-385e-4bf8-b760-8d9ed094a1c0 req-2ebf7acb-7ee9-435d-af28-1a663d2d1f47 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-2630b982-385e-4bf8-b760-8d9ed094a1c0 req-2ebf7acb-7ee9-435d-af28-1a663d2d1f47 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:22 user nova-compute[74261]: WARNING nova.compute.manager [req-2630b982-385e-4bf8-b760-8d9ed094a1c0 req-2ebf7acb-7ee9-435d-af28-1a663d2d1f47 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state active and task_state None.
Oct 17 11:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-changed-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Refreshing instance network info cache due to event network-changed-f8cbb1c4-5281-4d70-b56b-2ae92919975d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] Acquiring lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] Acquired lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Refreshing network info cache for port f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updated VIF entry in instance network info cache for port f8cbb1c4-5281-4d70-b56b-2ae92919975d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updating instance_info_cache with network_info: [{"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2d363ce-c116-4801-bc02-c687e6e72155 req-3c29ee6a-762b-4c48-896e-f084adac11a2 service nova] Releasing lock "refresh_cache-0a85cfbd-143d-45e2-9529-71cdde5fad52" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'flavor' on Instance uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:49:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:43 user nova-compute[74261]: INFO nova.compute.manager [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attaching volume b91af6ad-b594-4775-aa9e-cd8c6ad41987 to /dev/vdb
Oct 17 11:49:43 user nova-compute[74261]: DEBUG os_brick.utils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97ccdf-cd44-4805-b29c-ce0fb51ef8e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[22989cd8-da50-4ab5-8ee3-5c984c7a5d1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae2931-0d8a-42a1-ba40-bdc61b739a0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e967acb8-43ea-45eb-bd93-29a2b6bdd923]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:49:43 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:49:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfac2bde-a211-4b93-8e82-812ac84e5c30]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG os_brick.utils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updating existing volume attachment record: 7f53313d-b9a4-4038-940e-ecd572d623d8 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:49:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:53 user nova-compute[74261]: INFO nova.compute.manager [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Terminating instance
Oct 17 11:49:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-142b186b-e1bb-4b22-a11a-24243f229fe6 req-508d5e66-c532-4c49-b644-de67a7661f66 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-vif-unplugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-142b186b-e1bb-4b22-a11a-24243f229fe6 req-508d5e66-c532-4c49-b644-de67a7661f66 service nova] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-142b186b-e1bb-4b22-a11a-24243f229fe6 req-508d5e66-c532-4c49-b644-de67a7661f66 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-142b186b-e1bb-4b22-a11a-24243f229fe6 req-508d5e66-c532-4c49-b644-de67a7661f66 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-142b186b-e1bb-4b22-a11a-24243f229fe6 req-508d5e66-c532-4c49-b644-de67a7661f66 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] No waiting events found dispatching network-vif-unplugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-142b186b-e1bb-4b22-a11a-24243f229fe6 req-508d5e66-c532-4c49-b644-de67a7661f66 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-vif-unplugged-3efb487a-23f5-44f0-a34e-1145c39c2241 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Instance destroyed successfully.
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'resources' on Instance uuid 68fa8b56-a6bb-4201-b1b0-29d50408673e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-602880739',display_name='tempest-VolumesAdminNegativeTest-server-602880739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-602880739',id=13,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:47:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf4a57fa9484c8c8fc774664775226e',ramdisk_id='',reservation_id='r-02b9bbtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-593462057',owner_user_name='tempest-VolumesAdminNegativeTest-593462057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:47:56Z,user_data=None,user_id='3ab08ea77d1c44588ce76ec801bfa11e',uuid=68fa8b56-a6bb-4201-b1b0-29d50408673e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converting VIF {"id": "3efb487a-23f5-44f0-a34e-1145c39c2241", "address": "fa:16:3e:c2:cc:83", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb487a-23", "ovs_interfaceid": "3efb487a-23f5-44f0-a34e-1145c39c2241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG os_vif [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3efb487a-23, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56933796-c319-4d72-b077-f36517121203) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:54 user nova-compute[74261]: INFO os_vif [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:cc:83,bridge_name='br-int',has_traffic_filtering=True,id=3efb487a-23f5-44f0-a34e-1145c39c2241,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb487a-23')
Oct 17 11:49:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Deleting instance files /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e_del
Oct 17 11:49:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Deletion of /opt/stack/data/nova/instances/68fa8b56-a6bb-4201-b1b0-29d50408673e_del complete
Oct 17 11:49:54 user nova-compute[74261]: INFO nova.compute.manager [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 17 11:49:54 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:49:54 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:49:55 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Took 0.52 seconds to deallocate network for instance.
Oct 17 11:49:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-4904aaf7-981b-483f-b2ae-0eecc6ecbd31 req-5051da6b-93bb-4270-9763-f49c0405fab0 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-vif-deleted-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:49:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:55 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Deleted allocations for instance 68fa8b56-a6bb-4201-b1b0-29d50408673e
Oct 17 11:49:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-138a5c10-ce27-48ee-98f5-9a705717293f tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-00401d51-9463-4d89-9551-0f5dcb1db376 req-738ad07a-816a-4538-9f6a-ca42b05975c4 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received event network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:49:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-00401d51-9463-4d89-9551-0f5dcb1db376 req-738ad07a-816a-4538-9f6a-ca42b05975c4 service nova] Acquiring lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:49:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-00401d51-9463-4d89-9551-0f5dcb1db376 req-738ad07a-816a-4538-9f6a-ca42b05975c4 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:49:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-00401d51-9463-4d89-9551-0f5dcb1db376 req-738ad07a-816a-4538-9f6a-ca42b05975c4 service nova] Lock "68fa8b56-a6bb-4201-b1b0-29d50408673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:49:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-00401d51-9463-4d89-9551-0f5dcb1db376 req-738ad07a-816a-4538-9f6a-ca42b05975c4 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] No waiting events found dispatching network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:49:56 user nova-compute[74261]: WARNING nova.compute.manager [req-00401d51-9463-4d89-9551-0f5dcb1db376 req-738ad07a-816a-4538-9f6a-ca42b05975c4 service nova] [instance: 68fa8b56-a6bb-4201-b1b0-29d50408673e] Received unexpected event network-vif-plugged-3efb487a-23f5-44f0-a34e-1145c39c2241 for instance with vm_state deleted and task_state None.
Oct 17 11:49:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:49:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:49:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 11:49:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 11:49:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:50:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updating instance_info_cache with network_info: [{"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-6873f406-8c93-4d9d-b0d5-92296614b94b" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:01 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:01 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:01 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cd4789-b2f4-4f06-87ea-0ca791d19d4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:50:01 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee1aa4d-2a00-4d9a-a115-b96d8363642c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987] added
Oct 17 11:50:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09b7f0f-df95-4687-be31-3842dac6f8b4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c71ce-e674-4069-9cab-166c99eeb31e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZiurYUo {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZiurYUo" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7249d6c-714e-451b-b345-9429aec35e35]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZiurYUo'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ae7b88-4216-4538-96ed-e254c3f717ae]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b271a48a-671e-452c-abf1-1f8c6ccaa1aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[07053bd1-3a12-4968-af9d-d7f041378995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]
Oct 17 11:50:01 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.
Oct 17 11:50:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0470942b-5a7d-4d88-a61a-7198b24c90c3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e992e6-6bac-4141-b07f-3752d573805b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68459e8-aa26-4d03-bb8d-2393b534889b]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:50:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23664663631316139', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664663631316139', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'flavor' on Instance uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:50:02 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:02 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:50:02 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:02 user nova-compute[74261]:   <serial>b91af6ad-b594-4775-aa9e-cd8c6ad41987</serial>
Oct 17 11:50:02 user nova-compute[74261]: </disk>
Oct 17 11:50:02 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No VIF found with MAC fa:16:3e:51:4f:dc, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-def0d3c4-f29b-4799-baea-f0e8592776d2 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.586s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-changed-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Refreshing instance network info cache due to event network-changed-fb97e961-7b9b-4ea0-9071-85eb30c77ef6. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] Acquiring lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] Acquired lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Refreshing network info cache for port fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:05 user nova-compute[74261]: INFO nova.compute.manager [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Rebuilding instance
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:06 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:06 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7140MB free_disk=25.322322845458984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updated VIF entry in instance network info cache for port fb97e961-7b9b-4ea0-9071-85eb30c77ef6. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updating instance_info_cache with network_info: [{"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-460cc447-b4a2-4b65-91bc-56c49b86cf1a req-3eb61766-71c6-4b61-817a-873db069b7d4 service nova] Releasing lock "refresh_cache-a8ffb39b-874a-484d-9171-293bf5245fdd" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a037120-c55a-4394-99f2-7c1d6e5664b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a8ffb39b-874a-484d-9171-293bf5245fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0b77d95-170b-40bb-9336-3c0afa66e1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 11:50:06 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-dab882b0-cee7-4a1a-8834-83e958c79618 req-602f0609-96ff-4a53-ba83-d75a92a08cf1 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-unplugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dab882b0-cee7-4a1a-8834-83e958c79618 req-602f0609-96ff-4a53-ba83-d75a92a08cf1 service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dab882b0-cee7-4a1a-8834-83e958c79618 req-602f0609-96ff-4a53-ba83-d75a92a08cf1 service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dab882b0-cee7-4a1a-8834-83e958c79618 req-602f0609-96ff-4a53-ba83-d75a92a08cf1 service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-dab882b0-cee7-4a1a-8834-83e958c79618 req-602f0609-96ff-4a53-ba83-d75a92a08cf1 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-unplugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:07 user nova-compute[74261]: WARNING nova.compute.manager [req-dab882b0-cee7-4a1a-8834-83e958c79618 req-602f0609-96ff-4a53-ba83-d75a92a08cf1 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-unplugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state active and task_state rebuilding.
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 11:50:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance destroyed successfully.
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.967s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 11:50:07 user nova-compute[74261]: INFO nova.compute.manager [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Detaching volume b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:50:07 user nova-compute[74261]: INFO nova.virt.block_device [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attempting to driver detach volume b91af6ad-b594-4775-aa9e-cd8c6ad41987 from mountpoint /dev/vdb
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Attempting to detach device vdb from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:50:07 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:07 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:50:07 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:07 user nova-compute[74261]:   <serial>b91af6ad-b594-4775-aa9e-cd8c6ad41987</serial>
Oct 17 11:50:07 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:50:07 user nova-compute[74261]: </disk>
Oct 17 11:50:07 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:50:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully detached device vdb from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 from the persistent domain config.
Oct 17 11:50:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:07 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb54e0a2-a641-49c4-af40-db5788dde985]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:50:07 user nova-compute[74261]: No targets found.
Oct 17 11:50:07 user nova-compute[74261]: iSNS:
Oct 17 11:50:07 user nova-compute[74261]: No targets found.
Oct 17 11:50:07 user nova-compute[74261]: STATIC:
Oct 17 11:50:07 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:50:07 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:07 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:07 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:50:07 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:07 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:07 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:50:07 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:07 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:07 user nova-compute[74261]: FIRMWARE:
Oct 17 11:50:07 user nova-compute[74261]: No targets found.
Oct 17 11:50:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:50:07 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:50:07 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f211ac7d-7d1b-4298-9c54-c48dc120f454]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e160e22a-56f7-4511-a30f-6122231cb69b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:07 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:07 user nova-compute[74261]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:07 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:07 user nova-compute[74261]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2f5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987'): ({'sde'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Removing single pathed devices sde {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c304962-c71e-465e-a587-02a81629aefc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250d763-a41e-40b2-9e6c-05bd1294a19b]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flushing IO for device /dev/sde {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:50:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2feabfa-653e-4237-a6fa-21e5c8e5deab]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cec85-3373-4d90-ad34-f55271a1f795]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3582f4-034d-4af1-a287-56b810627475]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eecaf34-1ca3-4eae-9151-1b36d23231e8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]
Oct 17 11:50:08 user nova-compute[74261]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.
Oct 17 11:50:08 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[160c7ed9-3783-49dc-ad45-2e4fa3e5b53d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== disconnect_volume: return (361ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:50:08 user nova-compute[74261]: INFO nova.compute.manager [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Unrescuing
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:50:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-3db74904-11b1-4140-b87e-a64a23a8ea26 req-4a6119c1-03c5-435d-9afd-99b36ea2eb5d service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3db74904-11b1-4140-b87e-a64a23a8ea26 req-4a6119c1-03c5-435d-9afd-99b36ea2eb5d service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3db74904-11b1-4140-b87e-a64a23a8ea26 req-4a6119c1-03c5-435d-9afd-99b36ea2eb5d service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3db74904-11b1-4140-b87e-a64a23a8ea26 req-4a6119c1-03c5-435d-9afd-99b36ea2eb5d service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-3db74904-11b1-4140-b87e-a64a23a8ea26 req-4a6119c1-03c5-435d-9afd-99b36ea2eb5d service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:09 user nova-compute[74261]: WARNING nova.compute.manager [req-3db74904-11b1-4140-b87e-a64a23a8ea26 req-4a6119c1-03c5-435d-9afd-99b36ea2eb5d service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state active and task_state rebuilding.
Oct 17 11:50:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'flavor' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing instance network info cache due to event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG nova.network.neutron [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:50:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance destroyed successfully.
Oct 17 11:50:10 user nova-compute[74261]: DEBUG nova.network.neutron [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updated VIF entry in instance network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG nova.network.neutron [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9d778930-f4ca-436c-8de5-be7a7ee075d9 req-816ee5f1-b9d0-42e2-a44d-62f9b60d9534 service nova] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:11 user nova-compute[74261]: WARNING nova.compute.manager [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:50:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:11 user nova-compute[74261]: WARNING nova.compute.manager [req-20858f30-99c3-4792-a58d-d781aa43439c req-82424865-ba80-454c-a08e-495831c545b1 service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:50:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:12 user nova-compute[74261]: INFO nova.compute.manager [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Attaching volume c31109b2-0bfc-46e9-adb9-bdcbcba8a81f to /dev/vdb
Oct 17 11:50:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing instance network info cache due to event network-changed-7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] Acquiring lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] Acquired lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Refreshing network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG os_brick.utils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7bac87-6209-48c7-aeb0-c09fc42b0f43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d8bdd-ba84-4c6d-94c3-23df73457548]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8916924-21f3-4d57-98fc-f418f7a998f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc906d0-6a73-45eb-91e2-b10cfb54dd56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:12 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[07866eec-9b51-43f0-8749-6b778cbadb23]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG os_brick.utils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updating existing volume attachment record: 070afea7-d393-4389-8bbd-e362634df73f {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updated VIF entry in instance network info cache for port 7f10f299-2636-4403-80bf-e128689cdc4e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [{"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6659e7f7-0535-4e35-9eac-a1c81cfaf0c3 req-b6f892f5-da6b-47cd-a2e7-25a5854cf50c service nova] Releasing lock "refresh_cache-f07110f1-a355-47f2-9243-620b6ca41584" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:13 user nova-compute[74261]: WARNING nova.compute.manager [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:50:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:13 user nova-compute[74261]: WARNING nova.compute.manager [req-f36da783-578e-4cbf-904a-9d68fefa115d req-b5c6ce53-094f-4775-832d-ae9b9642106e service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:50:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8ffa443f-857f-45d7-b6e9-10ba24113faa tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance destroyed successfully.
Oct 17 11:50:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1162149465',display_name='tempest-ServerActionsTestOtherA-server-243977380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1162149465',id=14,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtR0YqoFrpPiXCoSahrCHnyzfIwThm6AY9VcZpOP9PuSc0xow/4PNQ5MD7rsPe3keZvknND3j9KNhoqBhKSvmX4b1Dq/mfceVXOpv9yoUBcd7t3YcYhCVRllEahAKNTig==',key_name='tempest-keypair-848116821',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:48:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-xt5s6fce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=0a85cfbd-143d-45e2-9529-71cdde5fad52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8cbb1c4-52, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ef36f02-4841-468c-a443-4b329a3d8fbf) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:18 user nova-compute[74261]: INFO os_vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52')
Oct 17 11:50:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:18 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea54262-c0b7-48f6-9b41-cacb6e4e78d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:50:18 user nova-compute[74261]: No targets found.
Oct 17 11:50:18 user nova-compute[74261]: iSNS:
Oct 17 11:50:18 user nova-compute[74261]: No targets found.
Oct 17 11:50:18 user nova-compute[74261]: STATIC:
Oct 17 11:50:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:50:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:50:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:18 user nova-compute[74261]: FIRMWARE:
Oct 17 11:50:18 user nova-compute[74261]: No targets found.
Oct 17 11:50:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:50:18 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:50:18 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb38f49-4c5b-45dd-8840-c1355fe61a2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d0da00-c199-49e9-b0fa-3055188c0b6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:18 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:18 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c192dd0>, {}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Disconnecting from: [] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== disconnect_volume: return (76ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:50:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Deleting instance files /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52_del
Oct 17 11:50:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Deletion of /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52_del complete
Oct 17 11:50:18 user nova-compute[74261]: INFO nova.virt.block_device [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Booting with volume b91af6ad-b594-4775-aa9e-cd8c6ad41987 at /dev/vdb
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.utils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[32008b66-3b96-4958-91ad-5f6ad5ffbe81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bafe3-3e26-4f77-82f2-b1bc37b39dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c20f7a-6fa7-4b26-8e3a-d49d027f004c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c037434e-f450-4de8-9590-d4ca5b0ef890]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:18 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:50:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16dba38-dd10-4c95-952c-4d004022a572]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG os_brick.utils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:18 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updating existing volume attachment record: 9f9a19c4-0c1d-4481-a713-a05ec6540da3 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:50:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:50:22 user nova-compute[74261]: INFO nova.compute.claims [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Claim successful on node user
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:50:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:50:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:50:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:50:23 user nova-compute[74261]: INFO nova.virt.block_device [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Booting with volume 90be0a73-9516-46e6-b82a-f9e4d588d2a5 at /dev/vda
Oct 17 11:50:23 user nova-compute[74261]: DEBUG nova.policy [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9491905f6ed54a8cbe025f465f663b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb14118064e6484894e9b4a79ab37c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG os_brick.utils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bd76ba-6c75-4c3f-a5e2-c6ff60527bc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c139be0-d23f-4f92-9613-43acab242dd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe40de1-6a3b-48b1-a5ce-5c1c80e1c89b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5cfd0-ad81-4c31-ae16-956103baedcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:23 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:50:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de3c682-c36d-43c6-9ea0-611432a46a07]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG os_brick.utils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating existing volume attachment record: 60ef5098-5c1c-4840-a26d-e348b53958a3 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:50:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:24 user nova-compute[74261]: DEBUG nova.network.neutron [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Successfully created port: 28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Successfully updated port: 28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquired lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-changed-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Refreshing instance network info cache due to event network-changed-28011a4c-3b68-47de-a6cb-af96182da3e3. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] Acquiring lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating instance_info_cache with network_info: [{"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Releasing lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance network_info: |[{"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] Acquired lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:25 user nova-compute[74261]: DEBUG nova.network.neutron [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Refreshing network info cache for port 28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:50:26 user nova-compute[74261]: DEBUG nova.network.neutron [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updated VIF entry in instance network info cache for port 28011a4c-3b68-47de-a6cb-af96182da3e3. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:50:26 user nova-compute[74261]: DEBUG nova.network.neutron [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating instance_info_cache with network_info: [{"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eb829ce0-181a-407f-895e-46293d9acf80 req-7fdf3e19-5fe5-4e0d-9d01-23f266c1b6fb service nova] Releasing lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqrODViG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:31 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:31 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:31 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[390ff1f0-b827-4d84-a7b6-8d636937f09f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:50:31 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcd6298-6ac8-42ec-9324-eb68ce05d194]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f] added
Oct 17 11:50:31 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b6ff9-e7b3-46d6-b918-7d27a6be9d18]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[707053de-129a-428c-b003-c20f6bfb915e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqrODViG {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqrODViG" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c57589-6240-4b1f-afc9-a1e1d76c7453]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqrODViG'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02ee522-6f43-4cc7-8f39-92777079c180]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8643d81-aa9f-4ef0-b6ae-46ef19f20059]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:31 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:31 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:31 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:31 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b61333-6a3c-4850-8388-7c970587a175]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260]
Oct 17 11:50:31 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260] successful.
Oct 17 11:50:31 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2e52c-46dd-4390-8f1a-82508319f307]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[639be3ae-f002-4e80-b7d1-c882e5e872f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:31 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:31 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:31 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:31 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:31 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:31 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6acefe-2001-4b37-a4b8-8940dde7e0ca]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqrODViG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:50:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26364653930643163', 'path': '/dev/sdd'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364653930643163', 'path': '/dev/sdd'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:50:32 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:32 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 11:50:32 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:32 user nova-compute[74261]:   <serial>c31109b2-0bfc-46e9-adb9-bdcbcba8a81f</serial>
Oct 17 11:50:32 user nova-compute[74261]: </disk>
Oct 17 11:50:32 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:32 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:67:b9:e1, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0956bbb-0959-4da6-9f29-08277c0f88ad tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.988s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:35 user nova-compute[74261]: WARNING nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid f0f6a950-d984-4ece-9a20-134bf800db37 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid f75b961a-6dc8-496f-b5e0-4c8967cc991d {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 6873f406-8c93-4d9d-b0d5-92296614b94b {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 408f6bb4-f944-4043-8e61-a62ac7d49938 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f07110f1-a355-47f2-9243-620b6ca41584" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: INFO nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f07110f1-a355-47f2-9243-620b6ca41584" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:50:36 user nova-compute[74261]: INFO nova.compute.claims [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Claim successful on node user
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "47c78622-6d42-43a6-93bb-298210ae07dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.135s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:50:36 user nova-compute[74261]: INFO nova.compute.claims [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Claim successful on node user
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.network.neutron [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:50:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.policy [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d191be36a54216a9e2d6a64660e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b95f3129c4493b0a69149e5b8dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:50:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Creating image(s)
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.209s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk 1073741824" returned: 0 in 0.062s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Successfully created port: cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:50:37 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.policy [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '126186127bc44a85ac39bb6bfbb0b8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe4687b8ef41248f726f6ddd948216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:50:37 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Creating image(s)
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "/opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Cannot resize image /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Ensure instance console log exists: /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:50:37 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Creating image(s)
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.241s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk 1073741824" returned: 0 in 0.060s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Successfully updated port: cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.049s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-changed-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Refreshing instance network info cache due to event network-changed-cfaa7969-500a-4718-a2f2-d0c6498d9844. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] Acquiring lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk 1073741824" returned: 0 in 0.055s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Cannot resize image /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Ensure instance console log exists: /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Instance network_info: |[{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] Acquired lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Refreshing network info cache for port cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Start _get_guest_xml network_info=[{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:50:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1031484196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1031484196',id=20,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-h8x50o05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:37Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:50:38 user nova-compute[74261]:   <uuid>1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3</uuid>
Oct 17 11:50:38 user nova-compute[74261]:   <name>instance-00000014</name>
Oct 17 11:50:38 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:50:38 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:50:38 user nova-compute[74261]:   <metadata>
Oct 17 11:50:38 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:50:38 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:50:38 user nova-compute[74261]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1031484196</nova:name>
Oct 17 11:50:38 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:50:38</nova:creationTime>
Oct 17 11:50:38 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:50:38 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:50:38 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:50:38 user nova-compute[74261]:       <nova:owner>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:user uuid="19d191be36a54216a9e2d6a64660e582">tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member</nova:user>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:project uuid="022b95f3129c4493b0a69149e5b8dd4e">tempest-ServerBootFromVolumeStableRescueTest-1400453141</nova:project>
Oct 17 11:50:38 user nova-compute[74261]:       </nova:owner>
Oct 17 11:50:38 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:50:38 user nova-compute[74261]:       <nova:ports>
Oct 17 11:50:38 user nova-compute[74261]:         <nova:port uuid="cfaa7969-500a-4718-a2f2-d0c6498d9844">
Oct 17 11:50:38 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 11:50:38 user nova-compute[74261]:         </nova:port>
Oct 17 11:50:38 user nova-compute[74261]:       </nova:ports>
Oct 17 11:50:38 user nova-compute[74261]:     </nova:instance>
Oct 17 11:50:38 user nova-compute[74261]:   </metadata>
Oct 17 11:50:38 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:50:38 user nova-compute[74261]:     <system>
Oct 17 11:50:38 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:50:38 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:50:38 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:50:38 user nova-compute[74261]:       <entry name="serial">1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3</entry>
Oct 17 11:50:38 user nova-compute[74261]:       <entry name="uuid">1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3</entry>
Oct 17 11:50:38 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:50:38 user nova-compute[74261]:     </system>
Oct 17 11:50:38 user nova-compute[74261]:   </sysinfo>
Oct 17 11:50:38 user nova-compute[74261]:   <os>
Oct 17 11:50:38 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:50:38 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:50:38 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:50:38 user nova-compute[74261]:   </os>
Oct 17 11:50:38 user nova-compute[74261]:   <features>
Oct 17 11:50:38 user nova-compute[74261]:     <acpi/>
Oct 17 11:50:38 user nova-compute[74261]:     <apic/>
Oct 17 11:50:38 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:50:38 user nova-compute[74261]:   </features>
Oct 17 11:50:38 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:50:38 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:50:38 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:50:38 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:50:38 user nova-compute[74261]:   </clock>
Oct 17 11:50:38 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:50:38 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:50:38 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:50:38 user nova-compute[74261]:   </cpu>
Oct 17 11:50:38 user nova-compute[74261]:   <devices>
Oct 17 11:50:38 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:50:38 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:50:38 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk"/>
Oct 17 11:50:38 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:50:38 user nova-compute[74261]:     </disk>
Oct 17 11:50:38 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:50:38 user nova-compute[74261]:       <mac address="fa:16:3e:9e:10:23"/>
Oct 17 11:50:38 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:38 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:50:38 user nova-compute[74261]:       <target dev="tapcfaa7969-50"/>
Oct 17 11:50:38 user nova-compute[74261]:     </interface>
Oct 17 11:50:38 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:50:38 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/console.log" append="off"/>
Oct 17 11:50:38 user nova-compute[74261]:     </serial>
Oct 17 11:50:38 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:50:38 user nova-compute[74261]:     <video>
Oct 17 11:50:38 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:38 user nova-compute[74261]:     </video>
Oct 17 11:50:38 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:50:38 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:50:38 user nova-compute[74261]:     </rng>
Oct 17 11:50:38 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:50:38 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:50:38 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:50:38 user nova-compute[74261]:     </memballoon>
Oct 17 11:50:38 user nova-compute[74261]:   </devices>
Oct 17 11:50:38 user nova-compute[74261]: </domain>
Oct 17 11:50:38 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1031484196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1031484196',id=20,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-h8x50o05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:37Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_vif [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ac0351d-7422-5a4d-b41f-80610dc88ea3', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfaa7969-50, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfaa7969-50, col_values=(('qos', UUID('d2173027-6d14-400c-8161-bf922cac4223')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfaa7969-50, col_values=(('external_ids', {'iface-id': 'cfaa7969-500a-4718-a2f2-d0c6498d9844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:10:23', 'vm-uuid': '1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:38 user nova-compute[74261]: INFO os_vif [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50')
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Cannot resize image /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Ensure instance console log exists: /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Start _get_guest_xml network_info=[{"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '9f9a19c4-0c1d-4481-a713-a05ec6540da3', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a85cfbd-143d-45e2-9529-71cdde5fad52', 'attached_at': '', 'detached_at': '', 'volume_id': 'b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'serial': 'b91af6ad-b594-4775-aa9e-cd8c6ad41987'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:50:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 11:50:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Successfully created port: 78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No VIF found with MAC fa:16:3e:9e:10:23, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:38 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:38 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:38 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60baa98-cd35-43ba-90fb-f4afe80ee146]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:50:38 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c63ee5c-5e63-4958-b09e-87fe4108c2be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987] added
Oct 17 11:50:38 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db22248f-70bc-4adf-95b8-55d354a96e6a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: INFO nova.compute.manager [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Detaching volume 404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ddcdc-15a5-4bb4-a328-e57aebf5ffe6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZiurYUo {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZiurYUo" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbddef9-cd20-40f6-be22-a6bb23181d46]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZiurYUo'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:39 user nova-compute[74261]: INFO nova.virt.block_device [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Attempting to driver detach volume 404c28d5-d363-40eb-8b0d-94ea33bf54ab from mountpoint /dev/vdb
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b588a-e5b5-4110-96ec-d5b212fcc316]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Attempting to detach device vdb from instance 93fe26e6-4a68-4976-b53c-3c33250c20de from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:50:39 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:39 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:50:39 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:39 user nova-compute[74261]:   <serial>404c28d5-d363-40eb-8b0d-94ea33bf54ab</serial>
Oct 17 11:50:39 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:50:39 user nova-compute[74261]: </disk>
Oct 17 11:50:39 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c610a2b-b316-444b-a396-827c14912820]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully detached device vdb from instance 93fe26e6-4a68-4976-b53c-3c33250c20de from the persistent domain config.
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93fe26e6-4a68-4976-b53c-3c33250c20de from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:50:39 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:39 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:50:39 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:39 user nova-compute[74261]:   <serial>404c28d5-d363-40eb-8b0d-94ea33bf54ab</serial>
Oct 17 11:50:39 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:50:39 user nova-compute[74261]: </disk>
Oct 17 11:50:39 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updated VIF entry in instance network info cache for port cfaa7969-500a-4718-a2f2-d0c6498d9844. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d003f-674b-46b9-aac8-51060acac713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]
Oct 17 11:50:39 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.
Oct 17 11:50:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ddec0f6-3fae-4ce0-bed9-8f21140cbf26 req-c96f8cb1-a5fe-4fe0-a2a2-45bc17ff1796 service nova] Releasing lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[83703e59-c5cf-424c-b03e-4c9fc3ff1e06]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4ef03-fb82-4b3a-b6e2-5c28971e06d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:39 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:39 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45a827-2435-4bd3-ba0e-0ea6c2220fa7]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Successfully updated port: 78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquired lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-changed-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Refreshing instance network info cache due to event network-changed-78b07125-b7dd-4f7f-bfdd-7f4d044cd258. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] Acquiring lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Updating instance_info_cache with network_info: [{"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Releasing lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Instance network_info: |[{"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] Acquired lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Refreshing network info cache for port 78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Start _get_guest_xml network_info=[{"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:50:39 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:39 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-158560098',display_name='tempest-AttachVolumeNegativeTest-server-158560098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-158560098',id=21,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjsO/M12kCbMLMwkgON1+9xusUw/2Cf2p5GYIiLuVRI4ZFrmcg2UVxrz5x+HGeORfaIwDmPpC0ZbyVUYyhK2zwqYEhWX1CE/Dd3TKfOL0OHMBW9YZLC6Mn+mV52CGXHaw==',key_name='tempest-keypair-1198983276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-6k4oaw9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=47c78622-6d42-43a6-93bb-298210ae07dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'pci_devices' on Instance uuid 47c78622-6d42-43a6-93bb-298210ae07dc {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:50:39 user nova-compute[74261]:   <uuid>47c78622-6d42-43a6-93bb-298210ae07dc</uuid>
Oct 17 11:50:39 user nova-compute[74261]:   <name>instance-00000015</name>
Oct 17 11:50:39 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:50:39 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:50:39 user nova-compute[74261]:   <metadata>
Oct 17 11:50:39 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:50:39 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:50:39 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeNegativeTest-server-158560098</nova:name>
Oct 17 11:50:39 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:50:39</nova:creationTime>
Oct 17 11:50:39 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:50:39 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:50:39 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:50:39 user nova-compute[74261]:       <nova:owner>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:user uuid="126186127bc44a85ac39bb6bfbb0b8c6">tempest-AttachVolumeNegativeTest-1274994880-project-member</nova:user>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:project uuid="c2fe4687b8ef41248f726f6ddd948216">tempest-AttachVolumeNegativeTest-1274994880</nova:project>
Oct 17 11:50:39 user nova-compute[74261]:       </nova:owner>
Oct 17 11:50:39 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:50:39 user nova-compute[74261]:       <nova:ports>
Oct 17 11:50:39 user nova-compute[74261]:         <nova:port uuid="78b07125-b7dd-4f7f-bfdd-7f4d044cd258">
Oct 17 11:50:39 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 11:50:39 user nova-compute[74261]:         </nova:port>
Oct 17 11:50:39 user nova-compute[74261]:       </nova:ports>
Oct 17 11:50:39 user nova-compute[74261]:     </nova:instance>
Oct 17 11:50:39 user nova-compute[74261]:   </metadata>
Oct 17 11:50:39 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:50:39 user nova-compute[74261]:     <system>
Oct 17 11:50:39 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:50:39 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:50:39 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:50:39 user nova-compute[74261]:       <entry name="serial">47c78622-6d42-43a6-93bb-298210ae07dc</entry>
Oct 17 11:50:39 user nova-compute[74261]:       <entry name="uuid">47c78622-6d42-43a6-93bb-298210ae07dc</entry>
Oct 17 11:50:39 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:50:39 user nova-compute[74261]:     </system>
Oct 17 11:50:39 user nova-compute[74261]:   </sysinfo>
Oct 17 11:50:39 user nova-compute[74261]:   <os>
Oct 17 11:50:39 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:50:39 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:50:39 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:50:39 user nova-compute[74261]:   </os>
Oct 17 11:50:39 user nova-compute[74261]:   <features>
Oct 17 11:50:39 user nova-compute[74261]:     <acpi/>
Oct 17 11:50:39 user nova-compute[74261]:     <apic/>
Oct 17 11:50:39 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:50:39 user nova-compute[74261]:   </features>
Oct 17 11:50:39 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:50:39 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:50:39 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:50:39 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:50:39 user nova-compute[74261]:   </clock>
Oct 17 11:50:39 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:50:39 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:50:39 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:50:39 user nova-compute[74261]:   </cpu>
Oct 17 11:50:39 user nova-compute[74261]:   <devices>
Oct 17 11:50:39 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:50:39 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:50:39 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk"/>
Oct 17 11:50:39 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:50:39 user nova-compute[74261]:     </disk>
Oct 17 11:50:39 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:50:39 user nova-compute[74261]:       <mac address="fa:16:3e:f3:0a:0f"/>
Oct 17 11:50:39 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:39 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:50:39 user nova-compute[74261]:       <target dev="tap78b07125-b7"/>
Oct 17 11:50:39 user nova-compute[74261]:     </interface>
Oct 17 11:50:39 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:50:39 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/console.log" append="off"/>
Oct 17 11:50:39 user nova-compute[74261]:     </serial>
Oct 17 11:50:39 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:50:39 user nova-compute[74261]:     <video>
Oct 17 11:50:39 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:39 user nova-compute[74261]:     </video>
Oct 17 11:50:39 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:50:39 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:50:39 user nova-compute[74261]:     </rng>
Oct 17 11:50:39 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:50:39 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:50:39 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:50:39 user nova-compute[74261]:     </memballoon>
Oct 17 11:50:39 user nova-compute[74261]:   </devices>
Oct 17 11:50:39 user nova-compute[74261]: </domain>
Oct 17 11:50:39 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-158560098',display_name='tempest-AttachVolumeNegativeTest-server-158560098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-158560098',id=21,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjsO/M12kCbMLMwkgON1+9xusUw/2Cf2p5GYIiLuVRI4ZFrmcg2UVxrz5x+HGeORfaIwDmPpC0ZbyVUYyhK2zwqYEhWX1CE/Dd3TKfOL0OHMBW9YZLC6Mn+mV52CGXHaw==',key_name='tempest-keypair-1198983276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-6k4oaw9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=47c78622-6d42-43a6-93bb-298210ae07dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG os_vif [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '763b9472-d8da-5ddc-a481-dfe5fbfb0408', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78b07125-b7, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78b07125-b7, col_values=(('qos', UUID('91a544fb-b00d-4446-9ef4-31e7ad81443a')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78b07125-b7, col_values=(('external_ids', {'iface-id': '78b07125-b7dd-4f7f-bfdd-7f4d044cd258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:0a:0f', 'vm-uuid': '47c78622-6d42-43a6-93bb-298210ae07dc'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:39 user nova-compute[74261]: INFO os_vif [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7')
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:f3:0a:0f, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23664663631316139', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664663631316139', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Updated VIF entry in instance network info cache for port 78b07125-b7dd-4f7f-bfdd-7f4d044cd258. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Updating instance_info_cache with network_info: [{"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d989f3d7-0c10-4103-b62a-86f6fcc5a391 req-adaa5cd6-40f0-4071-aa22-e030fb67da43 service nova] Releasing lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1162149465',display_name='tempest-ServerActionsTestOtherA-server-243977380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1162149465',id=14,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtR0YqoFrpPiXCoSahrCHnyzfIwThm6AY9VcZpOP9PuSc0xow/4PNQ5MD7rsPe3keZvknND3j9KNhoqBhKSvmX4b1Dq/mfceVXOpv9yoUBcd7t3YcYhCVRllEahAKNTig==',key_name='tempest-keypair-848116821',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:48:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-xt5s6fce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=0a85cfbd-143d-45e2-9529-71cdde5fad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:50:40 user nova-compute[74261]:   <uuid>0a85cfbd-143d-45e2-9529-71cdde5fad52</uuid>
Oct 17 11:50:40 user nova-compute[74261]:   <name>instance-0000000e</name>
Oct 17 11:50:40 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:50:40 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:50:40 user nova-compute[74261]:   <metadata>
Oct 17 11:50:40 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:50:40 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:50:40 user nova-compute[74261]:       <nova:name>tempest-ServerActionsTestOtherA-server-243977380</nova:name>
Oct 17 11:50:40 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:50:38</nova:creationTime>
Oct 17 11:50:40 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:50:40 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:50:40 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:50:40 user nova-compute[74261]:       <nova:owner>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:user uuid="4f29e0ea554e49c6b7ea83629e0f88c6">tempest-ServerActionsTestOtherA-203196858-project-member</nova:user>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:project uuid="8e92694390284b84b82715d4086494e9">tempest-ServerActionsTestOtherA-203196858</nova:project>
Oct 17 11:50:40 user nova-compute[74261]:       </nova:owner>
Oct 17 11:50:40 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:50:40 user nova-compute[74261]:       <nova:ports>
Oct 17 11:50:40 user nova-compute[74261]:         <nova:port uuid="f8cbb1c4-5281-4d70-b56b-2ae92919975d">
Oct 17 11:50:40 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 11:50:40 user nova-compute[74261]:         </nova:port>
Oct 17 11:50:40 user nova-compute[74261]:       </nova:ports>
Oct 17 11:50:40 user nova-compute[74261]:     </nova:instance>
Oct 17 11:50:40 user nova-compute[74261]:   </metadata>
Oct 17 11:50:40 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:50:40 user nova-compute[74261]:     <system>
Oct 17 11:50:40 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:50:40 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:50:40 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:50:40 user nova-compute[74261]:       <entry name="serial">0a85cfbd-143d-45e2-9529-71cdde5fad52</entry>
Oct 17 11:50:40 user nova-compute[74261]:       <entry name="uuid">0a85cfbd-143d-45e2-9529-71cdde5fad52</entry>
Oct 17 11:50:40 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:50:40 user nova-compute[74261]:     </system>
Oct 17 11:50:40 user nova-compute[74261]:   </sysinfo>
Oct 17 11:50:40 user nova-compute[74261]:   <os>
Oct 17 11:50:40 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:50:40 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:50:40 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:50:40 user nova-compute[74261]:   </os>
Oct 17 11:50:40 user nova-compute[74261]:   <features>
Oct 17 11:50:40 user nova-compute[74261]:     <acpi/>
Oct 17 11:50:40 user nova-compute[74261]:     <apic/>
Oct 17 11:50:40 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:50:40 user nova-compute[74261]:   </features>
Oct 17 11:50:40 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:50:40 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:50:40 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:50:40 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:50:40 user nova-compute[74261]:   </clock>
Oct 17 11:50:40 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:50:40 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:50:40 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:50:40 user nova-compute[74261]:   </cpu>
Oct 17 11:50:40 user nova-compute[74261]:   <devices>
Oct 17 11:50:40 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:50:40 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:50:40 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk"/>
Oct 17 11:50:40 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:50:40 user nova-compute[74261]:     </disk>
Oct 17 11:50:40 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:50:40 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:40 user nova-compute[74261]:       <source dev="/dev/sde"/>
Oct 17 11:50:40 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:50:40 user nova-compute[74261]:       <serial>b91af6ad-b594-4775-aa9e-cd8c6ad41987</serial>
Oct 17 11:50:40 user nova-compute[74261]:     </disk>
Oct 17 11:50:40 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:50:40 user nova-compute[74261]:       <mac address="fa:16:3e:51:4f:dc"/>
Oct 17 11:50:40 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:40 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:50:40 user nova-compute[74261]:       <target dev="tapf8cbb1c4-52"/>
Oct 17 11:50:40 user nova-compute[74261]:     </interface>
Oct 17 11:50:40 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:50:40 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/console.log" append="off"/>
Oct 17 11:50:40 user nova-compute[74261]:     </serial>
Oct 17 11:50:40 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:50:40 user nova-compute[74261]:     <video>
Oct 17 11:50:40 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:40 user nova-compute[74261]:     </video>
Oct 17 11:50:40 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:50:40 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:50:40 user nova-compute[74261]:     </rng>
Oct 17 11:50:40 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:50:40 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:50:40 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:50:40 user nova-compute[74261]:     </memballoon>
Oct 17 11:50:40 user nova-compute[74261]:   </devices>
Oct 17 11:50:40 user nova-compute[74261]: </domain>
Oct 17 11:50:40 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1162149465',display_name='tempest-ServerActionsTestOtherA-server-243977380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1162149465',id=14,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtR0YqoFrpPiXCoSahrCHnyzfIwThm6AY9VcZpOP9PuSc0xow/4PNQ5MD7rsPe3keZvknND3j9KNhoqBhKSvmX4b1Dq/mfceVXOpv9yoUBcd7t3YcYhCVRllEahAKNTig==',key_name='tempest-keypair-848116821',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:48:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-xt5s6fce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=0a85cfbd-143d-45e2-9529-71cdde5fad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG os_vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc12b13a-e62d-579b-b635-b1cd05275523', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8cbb1c4-52, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8cbb1c4-52, col_values=(('qos', UUID('f53b8ec0-5474-4f5d-8cd0-ffdf6f4dd32e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8cbb1c4-52, col_values=(('external_ids', {'iface-id': 'f8cbb1c4-5281-4d70-b56b-2ae92919975d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:4f:dc', 'vm-uuid': '0a85cfbd-143d-45e2-9529-71cdde5fad52'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:40 user nova-compute[74261]: INFO os_vif [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52')
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No VIF found with MAC fa:16:3e:51:4f:dc, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:41 user nova-compute[74261]: INFO nova.compute.manager [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Detaching volume 9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:50:42 user nova-compute[74261]: INFO nova.virt.block_device [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Attempting to driver detach volume 9e409f6a-94c2-4649-a458-7b85b4d00487 from mountpoint /dev/vdb
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Attempting to detach device vdb from instance f07110f1-a355-47f2-9243-620b6ca41584 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:50:42 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:42 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:50:42 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:42 user nova-compute[74261]:   <serial>9e409f6a-94c2-4649-a458-7b85b4d00487</serial>
Oct 17 11:50:42 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:50:42 user nova-compute[74261]: </disk>
Oct 17 11:50:42 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:50:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Successfully detached device vdb from instance f07110f1-a355-47f2-9243-620b6ca41584 from the persistent domain config.
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f07110f1-a355-47f2-9243-620b6ca41584 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:50:42 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:42 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:50:42 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:50:42 user nova-compute[74261]:   <serial>9e409f6a-94c2-4649-a458-7b85b4d00487</serial>
Oct 17 11:50:42 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:50:42 user nova-compute[74261]: </disk>
Oct 17 11:50:42 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:50:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Creating image(s)
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Ensure instance console log exists: /opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Start _get_guest_xml network_info=[{"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '60ef5098-5c1c-4840-a26d-e348b53958a3', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '408f6bb4-f944-4043-8e61-a62ac7d49938', 'attached_at': '', 'detached_at': '', 'volume_id': '90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'serial': '90be0a73-9516-46e6-b82a-f9e4d588d2a5'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:50:42 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:42 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:42 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:42 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:42 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b379de-5f45-4e55-ab44-2a5864bec4ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:50:42 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-e502b386-14e5-4ab6-a486-3f167eddfde4 req-6017eaac-3f7e-4394-880e-403121b19152 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e502b386-14e5-4ab6-a486-3f167eddfde4 req-6017eaac-3f7e-4394-880e-403121b19152 service nova] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e502b386-14e5-4ab6-a486-3f167eddfde4 req-6017eaac-3f7e-4394-880e-403121b19152 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e502b386-14e5-4ab6-a486-3f167eddfde4 req-6017eaac-3f7e-4394-880e-403121b19152 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-e502b386-14e5-4ab6-a486-3f167eddfde4 req-6017eaac-3f7e-4394-880e-403121b19152 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] No waiting events found dispatching network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:42 user nova-compute[74261]: WARNING nova.compute.manager [req-e502b386-14e5-4ab6-a486-3f167eddfde4 req-6017eaac-3f7e-4394-880e-403121b19152 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received unexpected event network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 for instance with vm_state building and task_state spawning.
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8c507-a30c-4286-9098-6ec44bc71d8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5] added
Oct 17 11:50:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[562fb68c-b2e5-42e6-b7e8-e1979a30a95f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ece2f9-e498-484c-ba06-f3976733485d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPBqHein {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPBqHein" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa9428-b2fb-4833-9f66-67afc43eb0fb]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hPBqHein'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3741ef-0b92-49af-a89a-f41f5ed6f17d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dae8f8-b9bd-428e-9c57-472a3fc75e7f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[84121fab-81aa-4b4c-835c-af6e8a18706b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]
Oct 17 11:50:42 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.
Oct 17 11:50:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d163b-5682-44cb-9126-2452efc36888]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3e55c-7345-4794-8c9c-3291ba4b46ce]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55afae31-e1da-4a6c-9cfe-43af77d5ac01]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:50:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23834633866663433', 'path': '/dev/sdf'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834633866663433', 'path': '/dev/sdf'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-669144641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-669144641',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe0H6TYJKtnM5UZxmp/5bHuEIzV0OVEDrIFCPQDY/SO41uj9ABVdiu5V1E6uGlhC8TuUzI7/t4NohLrqHWMbM7ORBEcE9rrb6hRtwcufBsxZzn5h8m8f0JBnSJcCA0d4g==',key_name='tempest-keypair-619756720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb14118064e6484894e9b4a79ab37c84',ramdisk_id='',reservation_id='r-7jcews07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-260506164',owner_user_name='tempest-ServerActionsV293TestJSON-260506164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9491905f6ed54a8cbe025f465f663b30',uuid=408f6bb4-f944-4043-8e61-a62ac7d49938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converting VIF {"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.objects.instance [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lazy-loading 'pci_devices' on Instance uuid 408f6bb4-f944-4043-8e61-a62ac7d49938 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:50:43 user nova-compute[74261]:   <uuid>408f6bb4-f944-4043-8e61-a62ac7d49938</uuid>
Oct 17 11:50:43 user nova-compute[74261]:   <name>instance-00000013</name>
Oct 17 11:50:43 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:50:43 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:50:43 user nova-compute[74261]:   <metadata>
Oct 17 11:50:43 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:50:43 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:50:43 user nova-compute[74261]:       <nova:name>tempest-ServerActionsV293TestJSON-server-669144641</nova:name>
Oct 17 11:50:43 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:50:42</nova:creationTime>
Oct 17 11:50:43 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:50:43 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:50:43 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:50:43 user nova-compute[74261]:       <nova:owner>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:user uuid="9491905f6ed54a8cbe025f465f663b30">tempest-ServerActionsV293TestJSON-260506164-project-member</nova:user>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:project uuid="eb14118064e6484894e9b4a79ab37c84">tempest-ServerActionsV293TestJSON-260506164</nova:project>
Oct 17 11:50:43 user nova-compute[74261]:       </nova:owner>
Oct 17 11:50:43 user nova-compute[74261]:       <nova:ports>
Oct 17 11:50:43 user nova-compute[74261]:         <nova:port uuid="28011a4c-3b68-47de-a6cb-af96182da3e3">
Oct 17 11:50:43 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 11:50:43 user nova-compute[74261]:         </nova:port>
Oct 17 11:50:43 user nova-compute[74261]:       </nova:ports>
Oct 17 11:50:43 user nova-compute[74261]:     </nova:instance>
Oct 17 11:50:43 user nova-compute[74261]:   </metadata>
Oct 17 11:50:43 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:50:43 user nova-compute[74261]:     <system>
Oct 17 11:50:43 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:50:43 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:50:43 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:50:43 user nova-compute[74261]:       <entry name="serial">408f6bb4-f944-4043-8e61-a62ac7d49938</entry>
Oct 17 11:50:43 user nova-compute[74261]:       <entry name="uuid">408f6bb4-f944-4043-8e61-a62ac7d49938</entry>
Oct 17 11:50:43 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:50:43 user nova-compute[74261]:     </system>
Oct 17 11:50:43 user nova-compute[74261]:   </sysinfo>
Oct 17 11:50:43 user nova-compute[74261]:   <os>
Oct 17 11:50:43 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:50:43 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:50:43 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:50:43 user nova-compute[74261]:   </os>
Oct 17 11:50:43 user nova-compute[74261]:   <features>
Oct 17 11:50:43 user nova-compute[74261]:     <acpi/>
Oct 17 11:50:43 user nova-compute[74261]:     <apic/>
Oct 17 11:50:43 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:50:43 user nova-compute[74261]:   </features>
Oct 17 11:50:43 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:50:43 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:50:43 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:50:43 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:50:43 user nova-compute[74261]:   </clock>
Oct 17 11:50:43 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:50:43 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:50:43 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:50:43 user nova-compute[74261]:   </cpu>
Oct 17 11:50:43 user nova-compute[74261]:   <devices>
Oct 17 11:50:43 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:50:43 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:50:43 user nova-compute[74261]:       <source dev="/dev/sdf"/>
Oct 17 11:50:43 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:50:43 user nova-compute[74261]:       <serial>90be0a73-9516-46e6-b82a-f9e4d588d2a5</serial>
Oct 17 11:50:43 user nova-compute[74261]:     </disk>
Oct 17 11:50:43 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:50:43 user nova-compute[74261]:       <mac address="fa:16:3e:48:42:e5"/>
Oct 17 11:50:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:43 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:50:43 user nova-compute[74261]:       <target dev="tap28011a4c-3b"/>
Oct 17 11:50:43 user nova-compute[74261]:     </interface>
Oct 17 11:50:43 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:50:43 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938/console.log" append="off"/>
Oct 17 11:50:43 user nova-compute[74261]:     </serial>
Oct 17 11:50:43 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:50:43 user nova-compute[74261]:     <video>
Oct 17 11:50:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:43 user nova-compute[74261]:     </video>
Oct 17 11:50:43 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:50:43 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:50:43 user nova-compute[74261]:     </rng>
Oct 17 11:50:43 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:50:43 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:50:43 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:50:43 user nova-compute[74261]:     </memballoon>
Oct 17 11:50:43 user nova-compute[74261]:   </devices>
Oct 17 11:50:43 user nova-compute[74261]: </domain>
Oct 17 11:50:43 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-669144641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-669144641',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe0H6TYJKtnM5UZxmp/5bHuEIzV0OVEDrIFCPQDY/SO41uj9ABVdiu5V1E6uGlhC8TuUzI7/t4NohLrqHWMbM7ORBEcE9rrb6hRtwcufBsxZzn5h8m8f0JBnSJcCA0d4g==',key_name='tempest-keypair-619756720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb14118064e6484894e9b4a79ab37c84',ramdisk_id='',reservation_id='r-7jcews07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-260506164',owner_user_name='tempest-ServerActionsV293TestJSON-260506164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9491905f6ed54a8cbe025f465f663b30',uuid=408f6bb4-f944-4043-8e61-a62ac7d49938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converting VIF {"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG os_vif [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ae07d20-5afd-58ad-8b07-229747deaf89', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28011a4c-3b, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28011a4c-3b, col_values=(('qos', UUID('6f210af6-82c1-4200-90b9-b2a6d349f453')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28011a4c-3b, col_values=(('external_ids', {'iface-id': '28011a4c-3b68-47de-a6cb-af96182da3e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:42:e5', 'vm-uuid': '408f6bb4-f944-4043-8e61-a62ac7d49938'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: INFO os_vif [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b')
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-d5bf92b6-227a-4860-bad6-8f3b4b653478 req-d172a74f-b994-4c83-b2fc-4f75769af318 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d5bf92b6-227a-4860-bad6-8f3b4b653478 req-d172a74f-b994-4c83-b2fc-4f75769af318 service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d5bf92b6-227a-4860-bad6-8f3b4b653478 req-d172a74f-b994-4c83-b2fc-4f75769af318 service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d5bf92b6-227a-4860-bad6-8f3b4b653478 req-d172a74f-b994-4c83-b2fc-4f75769af318 service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-d5bf92b6-227a-4860-bad6-8f3b4b653478 req-d172a74f-b994-4c83-b2fc-4f75769af318 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:43 user nova-compute[74261]: WARNING nova.compute.manager [req-d5bf92b6-227a-4860-bad6-8f3b4b653478 req-d172a74f-b994-4c83-b2fc-4f75769af318 service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state active and task_state rebuild_spawning.
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] No VIF found with MAC fa:16:3e:48:42:e5, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-bebae847-a9a3-4bc5-9a45-2bfe44234e7d req-6b46e749-3f07-4df6-9b04-eddbbda51fa3 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bebae847-a9a3-4bc5-9a45-2bfe44234e7d req-6b46e749-3f07-4df6-9b04-eddbbda51fa3 service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bebae847-a9a3-4bc5-9a45-2bfe44234e7d req-6b46e749-3f07-4df6-9b04-eddbbda51fa3 service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bebae847-a9a3-4bc5-9a45-2bfe44234e7d req-6b46e749-3f07-4df6-9b04-eddbbda51fa3 service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-bebae847-a9a3-4bc5-9a45-2bfe44234e7d req-6b46e749-3f07-4df6-9b04-eddbbda51fa3 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:44 user nova-compute[74261]: WARNING nova.compute.manager [req-bebae847-a9a3-4bc5-9a45-2bfe44234e7d req-6b46e749-3f07-4df6-9b04-eddbbda51fa3 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received unexpected event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with vm_state building and task_state spawning.
Oct 17 11:50:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-9fe27e21-2114-496b-a0bc-06fa4e84c41a req-71c71ee2-b1bc-4b6a-9e1c-1467168a3e02 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fe27e21-2114-496b-a0bc-06fa4e84c41a req-71c71ee2-b1bc-4b6a-9e1c-1467168a3e02 service nova] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fe27e21-2114-496b-a0bc-06fa4e84c41a req-71c71ee2-b1bc-4b6a-9e1c-1467168a3e02 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fe27e21-2114-496b-a0bc-06fa4e84c41a req-71c71ee2-b1bc-4b6a-9e1c-1467168a3e02 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-9fe27e21-2114-496b-a0bc-06fa4e84c41a req-71c71ee2-b1bc-4b6a-9e1c-1467168a3e02 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] No waiting events found dispatching network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:44 user nova-compute[74261]: WARNING nova.compute.manager [req-9fe27e21-2114-496b-a0bc-06fa4e84c41a req-71c71ee2-b1bc-4b6a-9e1c-1467168a3e02 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received unexpected event network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 for instance with vm_state building and task_state spawning.
Oct 17 11:50:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-17bbf367-9cc0-46a1-b213-07c193222797 req-8cdb048b-dffa-48c7-8f4d-ef022299764d service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17bbf367-9cc0-46a1-b213-07c193222797 req-8cdb048b-dffa-48c7-8f4d-ef022299764d service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17bbf367-9cc0-46a1-b213-07c193222797 req-8cdb048b-dffa-48c7-8f4d-ef022299764d service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17bbf367-9cc0-46a1-b213-07c193222797 req-8cdb048b-dffa-48c7-8f4d-ef022299764d service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-17bbf367-9cc0-46a1-b213-07c193222797 req-8cdb048b-dffa-48c7-8f4d-ef022299764d service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:45 user nova-compute[74261]: WARNING nova.compute.manager [req-17bbf367-9cc0-46a1-b213-07c193222797 req-8cdb048b-dffa-48c7-8f4d-ef022299764d service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state active and task_state rebuild_spawning.
Oct 17 11:50:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-8003d8e7-a2a5-463c-b3dc-2fffa3f1323f req-14e3175b-065d-4ac0-bcb9-7b38c9a8364d service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8003d8e7-a2a5-463c-b3dc-2fffa3f1323f req-14e3175b-065d-4ac0-bcb9-7b38c9a8364d service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8003d8e7-a2a5-463c-b3dc-2fffa3f1323f req-14e3175b-065d-4ac0-bcb9-7b38c9a8364d service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8003d8e7-a2a5-463c-b3dc-2fffa3f1323f req-14e3175b-065d-4ac0-bcb9-7b38c9a8364d service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-8003d8e7-a2a5-463c-b3dc-2fffa3f1323f req-14e3175b-065d-4ac0-bcb9-7b38c9a8364d service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:46 user nova-compute[74261]: WARNING nova.compute.manager [req-8003d8e7-a2a5-463c-b3dc-2fffa3f1323f req-14e3175b-065d-4ac0-bcb9-7b38c9a8364d service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received unexpected event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with vm_state building and task_state spawning.
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:46 user nova-compute[74261]: WARNING nova.compute.manager [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state building and task_state spawning.
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:46 user nova-compute[74261]: WARNING nova.compute.manager [req-39fe5d56-9562-4811-9217-eb040aab6d26 req-80a771a6-5b13-4595-97f5-73fc1f07a1c9 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state building and task_state spawning.
Oct 17 11:50:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:50:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Instance spawned successfully.
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:46 user nova-compute[74261]: INFO nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Took 9.96 seconds to spawn the instance on the hypervisor.
Oct 17 11:50:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:46 user nova-compute[74261]: INFO nova.compute.manager [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Took 10.87 seconds to build instance.
Oct 17 11:50:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-de18f3d0-becf-4455-b1f1-95b095176e8b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.039s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:50:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance spawned successfully.
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:50:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Instance spawned successfully.
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:48 user nova-compute[74261]: INFO nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Took 10.53 seconds to spawn the instance on the hypervisor.
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74261) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 17 11:50:48 user nova-compute[74261]: INFO nova.compute.manager [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Took 11.78 seconds to build instance.
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ea3ab0d9-3be4-4006-9deb-c18cdbc86a34 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "47c78622-6d42-43a6-93bb-298210ae07dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.919s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d662148f-60f0-4003-8858-1e0395656ab8 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:50:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance spawned successfully.
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:50:48 user nova-compute[74261]: INFO nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Took 6.48 seconds to spawn the instance on the hypervisor.
Oct 17 11:50:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:48 user nova-compute[74261]: INFO nova.compute.manager [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Took 26.36 seconds to build instance.
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-173820e4-6080-4bc2-b37f-597c78216154 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.552s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.127s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:48 user nova-compute[74261]: INFO nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 17 11:50:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:50 user nova-compute[74261]: INFO nova.compute.manager [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Rescuing
Oct 17 11:50:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:50:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:50:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:50:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updating instance_info_cache with network_info: [{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce78abfe-1b71-433e-bc11-dc5e5dbacd68 req-0be72b3e-08aa-43a0-a813-c1c84d226863 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-unplugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce78abfe-1b71-433e-bc11-dc5e5dbacd68 req-0be72b3e-08aa-43a0-a813-c1c84d226863 service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce78abfe-1b71-433e-bc11-dc5e5dbacd68 req-0be72b3e-08aa-43a0-a813-c1c84d226863 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce78abfe-1b71-433e-bc11-dc5e5dbacd68 req-0be72b3e-08aa-43a0-a813-c1c84d226863 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce78abfe-1b71-433e-bc11-dc5e5dbacd68 req-0be72b3e-08aa-43a0-a813-c1c84d226863 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-unplugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:51 user nova-compute[74261]: WARNING nova.compute.manager [req-ce78abfe-1b71-433e-bc11-dc5e5dbacd68 req-0be72b3e-08aa-43a0-a813-c1c84d226863 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-unplugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state active and task_state rescuing.
Oct 17 11:50:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance destroyed successfully.
Oct 17 11:50:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Attempting rescue
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74261) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 11:50:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Creating image(s)
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'trusted_certs' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.231s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue" returned: 0 in 0.054s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'migration_context' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.base [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<a590a88c-15ce-478b-976d-7e1828eee2bf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Start _get_guest_xml network_info=[{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:c3:42:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'resources' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.base [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<a590a88c-15ce-478b-976d-7e1828eee2bf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'numa_topology' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.objects.base [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<a590a88c-15ce-478b-976d-7e1828eee2bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:50:52 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:52 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:50:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'vcpu_model' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.objects.base [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<a590a88c-15ce-478b-976d-7e1828eee2bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132186004',display_name='tempest-ServerRescueNegativeTestJSON-server-1132186004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132186004',id=17,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-4ah40h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:10Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=a590a88c-15ce-478b-976d-7e1828eee2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:c3:42:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:c3:42:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'pci_devices' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.objects.base [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<a590a88c-15ce-478b-976d-7e1828eee2bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:50:53 user nova-compute[74261]:   <uuid>a590a88c-15ce-478b-976d-7e1828eee2bf</uuid>
Oct 17 11:50:53 user nova-compute[74261]:   <name>instance-00000011</name>
Oct 17 11:50:53 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:50:53 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:50:53 user nova-compute[74261]:   <metadata>
Oct 17 11:50:53 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:50:53 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:50:53 user nova-compute[74261]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1132186004</nova:name>
Oct 17 11:50:53 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:50:52</nova:creationTime>
Oct 17 11:50:53 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:50:53 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:50:53 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:50:53 user nova-compute[74261]:       <nova:owner>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:user uuid="171d1037b5b74e09812373e40ef7c193">tempest-ServerRescueNegativeTestJSON-1673978463-project-member</nova:user>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:project uuid="ed0a71e6e0274702b67351ba09b91c7f">tempest-ServerRescueNegativeTestJSON-1673978463</nova:project>
Oct 17 11:50:53 user nova-compute[74261]:       </nova:owner>
Oct 17 11:50:53 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:50:53 user nova-compute[74261]:       <nova:ports>
Oct 17 11:50:53 user nova-compute[74261]:         <nova:port uuid="5c6fdc01-fdc1-486e-8e4f-f639d75dee12">
Oct 17 11:50:53 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 11:50:53 user nova-compute[74261]:         </nova:port>
Oct 17 11:50:53 user nova-compute[74261]:       </nova:ports>
Oct 17 11:50:53 user nova-compute[74261]:     </nova:instance>
Oct 17 11:50:53 user nova-compute[74261]:   </metadata>
Oct 17 11:50:53 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:50:53 user nova-compute[74261]:     <system>
Oct 17 11:50:53 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:50:53 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:50:53 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:50:53 user nova-compute[74261]:       <entry name="serial">a590a88c-15ce-478b-976d-7e1828eee2bf</entry>
Oct 17 11:50:53 user nova-compute[74261]:       <entry name="uuid">a590a88c-15ce-478b-976d-7e1828eee2bf</entry>
Oct 17 11:50:53 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:50:53 user nova-compute[74261]:     </system>
Oct 17 11:50:53 user nova-compute[74261]:   </sysinfo>
Oct 17 11:50:53 user nova-compute[74261]:   <os>
Oct 17 11:50:53 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:50:53 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:50:53 user nova-compute[74261]:   </os>
Oct 17 11:50:53 user nova-compute[74261]:   <features>
Oct 17 11:50:53 user nova-compute[74261]:     <acpi/>
Oct 17 11:50:53 user nova-compute[74261]:     <apic/>
Oct 17 11:50:53 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:50:53 user nova-compute[74261]:   </features>
Oct 17 11:50:53 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:50:53 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:50:53 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:50:53 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:50:53 user nova-compute[74261]:   </clock>
Oct 17 11:50:53 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:50:53 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:50:53 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:50:53 user nova-compute[74261]:   </cpu>
Oct 17 11:50:53 user nova-compute[74261]:   <devices>
Oct 17 11:50:53 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:50:53 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:50:53 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue"/>
Oct 17 11:50:53 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:50:53 user nova-compute[74261]:     </disk>
Oct 17 11:50:53 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:50:53 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:50:53 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk"/>
Oct 17 11:50:53 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:50:53 user nova-compute[74261]:     </disk>
Oct 17 11:50:53 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:50:53 user nova-compute[74261]:       <mac address="fa:16:3e:c3:42:eb"/>
Oct 17 11:50:53 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:53 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:50:53 user nova-compute[74261]:       <target dev="tap5c6fdc01-fd"/>
Oct 17 11:50:53 user nova-compute[74261]:     </interface>
Oct 17 11:50:53 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:50:53 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/console.log" append="off"/>
Oct 17 11:50:53 user nova-compute[74261]:     </serial>
Oct 17 11:50:53 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:50:53 user nova-compute[74261]:     <video>
Oct 17 11:50:53 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:50:53 user nova-compute[74261]:     </video>
Oct 17 11:50:53 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:50:53 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:50:53 user nova-compute[74261]:     </rng>
Oct 17 11:50:53 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:50:53 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:50:53 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:50:53 user nova-compute[74261]:     </memballoon>
Oct 17 11:50:53 user nova-compute[74261]:   </devices>
Oct 17 11:50:53 user nova-compute[74261]: </domain>
Oct 17 11:50:53 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:50:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance destroyed successfully.
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:c3:42:eb, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:50:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-311fc297-8229-4d7a-ac52-0d0317285a99 req-1726de61-b606-45b4-9035-9cd7c05bc460 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-311fc297-8229-4d7a-ac52-0d0317285a99 req-1726de61-b606-45b4-9035-9cd7c05bc460 service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-311fc297-8229-4d7a-ac52-0d0317285a99 req-1726de61-b606-45b4-9035-9cd7c05bc460 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-311fc297-8229-4d7a-ac52-0d0317285a99 req-1726de61-b606-45b4-9035-9cd7c05bc460 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-311fc297-8229-4d7a-ac52-0d0317285a99 req-1726de61-b606-45b4-9035-9cd7c05bc460 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:54 user nova-compute[74261]: WARNING nova.compute.manager [req-311fc297-8229-4d7a-ac52-0d0317285a99 req-1726de61-b606-45b4-9035-9cd7c05bc460 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state active and task_state rescuing.
Oct 17 11:50:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:55 user nova-compute[74261]: INFO nova.compute.manager [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Terminating instance
Oct 17 11:50:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-a9002907-4e07-4900-b1f1-feb4fb84c779 req-27f59489-7f0d-4847-8ef5-8467dc595c81 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-vif-unplugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a9002907-4e07-4900-b1f1-feb4fb84c779 req-27f59489-7f0d-4847-8ef5-8467dc595c81 service nova] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a9002907-4e07-4900-b1f1-feb4fb84c779 req-27f59489-7f0d-4847-8ef5-8467dc595c81 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a9002907-4e07-4900-b1f1-feb4fb84c779 req-27f59489-7f0d-4847-8ef5-8467dc595c81 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-a9002907-4e07-4900-b1f1-feb4fb84c779 req-27f59489-7f0d-4847-8ef5-8467dc595c81 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] No waiting events found dispatching network-vif-unplugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-a9002907-4e07-4900-b1f1-feb4fb84c779 req-27f59489-7f0d-4847-8ef5-8467dc595c81 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-vif-unplugged-dfb329d0-1c06-4db5-bc81-d62689969318 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:50:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:56 user nova-compute[74261]: WARNING nova.compute.manager [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state active and task_state rescuing.
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:56 user nova-compute[74261]: WARNING nova.compute.manager [req-1a3d973c-48e7-4066-9230-2143a2bcc335 req-865cd14b-3c5d-4013-bf07-e24be67a2662 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state active and task_state rescuing.
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Instance destroyed successfully.
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lazy-loading 'resources' on Instance uuid 0a037120-c55a-4394-99f2-7c1d6e5664b7 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-471937317',display_name='tempest-VolumesAdminNegativeTest-server-471937317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-471937317',id=7,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7DBU4idqsTvb0b/70roulCG20TqHa2mNSHvWE5JFWUEqkG3hzP7FzqPcYHhxf7KgZnlJdNdLXOW54sLrqhS8HsZEBNZsEmQJiR/VznrKf98XHi46D9lWqjct2Z9atxMA==',key_name='tempest-keypair-753395369',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf4a57fa9484c8c8fc774664775226e',ramdisk_id='',reservation_id='r-0t7nu652',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-593462057',owner_user_name='tempest-VolumesAdminNegativeTest-593462057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab08ea77d1c44588ce76ec801bfa11e',uuid=0a037120-c55a-4394-99f2-7c1d6e5664b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converting VIF {"id": "dfb329d0-1c06-4db5-bc81-d62689969318", "address": "fa:16:3e:9b:21:d4", "network": {"id": "44ae5bb7-df62-45d2-bb65-27864f4ef06a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-499238161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf4a57fa9484c8c8fc774664775226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb329d0-1c", "ovs_interfaceid": "dfb329d0-1c06-4db5-bc81-d62689969318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG os_vif [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfb329d0-1c, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=895e609e-ee95-472b-b247-b3ca4106609e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:50:56 user nova-compute[74261]: INFO os_vif [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=dfb329d0-1c06-4db5-bc81-d62689969318,network=Network(44ae5bb7-df62-45d2-bb65-27864f4ef06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb329d0-1c')
Oct 17 11:50:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Deleting instance files /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7_del
Oct 17 11:50:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Deletion of /opt/stack/data/nova/instances/0a037120-c55a-4394-99f2-7c1d6e5664b7_del complete
Oct 17 11:50:56 user nova-compute[74261]: INFO nova.compute.manager [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:56 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:50:56 user nova-compute[74261]: INFO nova.compute.claims [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Claim successful on node user
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:50:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.policy [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f23a8928f3f471dab8b2942438b24a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f713455cc64f2590e5e714f50eb1fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:50:57 user nova-compute[74261]: INFO nova.virt.block_device [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Booting with volume aa100a5d-910d-48c2-8a43-911c402fd074 at /dev/vda
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:50:57 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Took 1.12 seconds to deallocate network for instance.
Oct 17 11:50:57 user nova-compute[74261]: DEBUG os_brick.utils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f05e98-ceb7-40cf-ad51-dcc339cebb0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b970e3-7592-4efa-bcb9-5dea0727398b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-db339a77-fddd-4423-b861-ffa99ebd94d4 req-3a357e34-5d4f-4b89-a998-e97be0d67713 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-db339a77-fddd-4423-b861-ffa99ebd94d4 req-3a357e34-5d4f-4b89-a998-e97be0d67713 service nova] Acquiring lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-db339a77-fddd-4423-b861-ffa99ebd94d4 req-3a357e34-5d4f-4b89-a998-e97be0d67713 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-db339a77-fddd-4423-b861-ffa99ebd94d4 req-3a357e34-5d4f-4b89-a998-e97be0d67713 service nova] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-db339a77-fddd-4423-b861-ffa99ebd94d4 req-3a357e34-5d4f-4b89-a998-e97be0d67713 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] No waiting events found dispatching network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:50:57 user nova-compute[74261]: WARNING nova.compute.manager [req-db339a77-fddd-4423-b861-ffa99ebd94d4 req-3a357e34-5d4f-4b89-a998-e97be0d67713 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received unexpected event network-vif-plugged-dfb329d0-1c06-4db5-bc81-d62689969318 for instance with vm_state deleted and task_state None.
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7789d2e0-5d4f-47e7-9235-31b5d09b95ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[787458e5-fcbb-44e6-a7d0-23e7f021b726]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:50:58 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:50:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19673cd-2191-4d79-8dd4-660f585f88c7]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-7cd3e2db-7bea-4901-ad97-3534c69a27af req-ca5a1d52-61bd-4f23-a3f4-3e29e3750c94 service nova] [instance: 0a037120-c55a-4394-99f2-7c1d6e5664b7] Received event network-vif-deleted-dfb329d0-1c06-4db5-bc81-d62689969318 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-95e7780c-47e6-4771-abf8-b4831f1d1f23 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG os_brick.utils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== get_connector_properties: return (500ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating existing volume attachment record: 054e8eae-4792-4a9a-9521-4bdc6586e852 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully created port: 84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:50:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.070s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:58 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Deleted allocations for instance 0a037120-c55a-4394-99f2-7c1d6e5664b7
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a838f4ad-16ff-456d-9cf6-9430793be29d tempest-VolumesAdminNegativeTest-593462057 tempest-VolumesAdminNegativeTest-593462057-project-member] Lock "0a037120-c55a-4394-99f2-7c1d6e5664b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.809s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully created port: 27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:50:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 93fe26e6-4a68-4976-b53c-3c33250c20de is timed out.
Oct 17 11:50:59 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully detached device vdb from instance 93fe26e6-4a68-4976-b53c-3c33250c20de from the live domain config.
Oct 17 11:50:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DexHRSiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:50:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aa9fee-54f1-40bc-8bf1-2b7ce48946c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:50:59 user nova-compute[74261]: No targets found.
Oct 17 11:50:59 user nova-compute[74261]: iSNS:
Oct 17 11:50:59 user nova-compute[74261]: No targets found.
Oct 17 11:50:59 user nova-compute[74261]: STATIC:
Oct 17 11:50:59 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:50:59 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:59 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:59 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:50:59 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:59 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:59 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab
Oct 17 11:50:59 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:59 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:59 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:50:59 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:59 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:59 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:50:59 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:50:59 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:50:59 user nova-compute[74261]: FIRMWARE:
Oct 17 11:50:59 user nova-compute[74261]: No targets found.
Oct 17 11:50:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:50:59 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:50:59 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb018fb-55a5-4ffd-b985-a8e3fce45020]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c6aa0-5228-4ba8-bbf7-f0cdbdcee5f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:50:59 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:50:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2f6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca59e5-8ba0-41ba-b654-6d936b2abead]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f9f59-17be-4750-a889-4f600e1bae88]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c9270-25e5-4f33-a9ae-088b54adee73]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e3bf1-33ee-4b7a-83ad-f8d08d05c4aa]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41b1158-b88e-4352-9666-78615384c303]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6078df0-80a8-4376-9d06-c8dd49597469]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260]
Oct 17 11:50:59 user nova-compute[74261]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab, portal: 172.16.0.220,3260] successful.
Oct 17 11:50:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404c28d5-d363-40eb-8b0d-94ea33bf54ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f837a5-e633-41a8-9af1-a11137c44e2c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== disconnect_volume: return (436ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:50:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:51:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully created port: a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:51:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2a5294ec-f020-4ccb-9b35-3ea4b9f37ede tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.377s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully created port: ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74261) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully created port: 78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-8c57312e-740c-43ab-b387-7bca8bbe8943 req-b0a4055d-ecfe-4670-99d3-a9a4bcdb2e60 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8c57312e-740c-43ab-b387-7bca8bbe8943 req-b0a4055d-ecfe-4670-99d3-a9a4bcdb2e60 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8c57312e-740c-43ab-b387-7bca8bbe8943 req-b0a4055d-ecfe-4670-99d3-a9a4bcdb2e60 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8c57312e-740c-43ab-b387-7bca8bbe8943 req-b0a4055d-ecfe-4670-99d3-a9a4bcdb2e60 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-8c57312e-740c-43ab-b387-7bca8bbe8943 req-b0a4055d-ecfe-4670-99d3-a9a4bcdb2e60 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:51:02 user nova-compute[74261]: WARNING nova.compute.manager [req-8c57312e-740c-43ab-b387-7bca8bbe8943 req-b0a4055d-ecfe-4670-99d3-a9a4bcdb2e60 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state active and task_state powering-off.
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f07110f1-a355-47f2-9243-620b6ca41584 is timed out.
Oct 17 11:51:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Successfully detached device vdb from instance f07110f1-a355-47f2-9243-620b6ca41584 from the live domain config.
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsjmvIFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:03 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3679548a-0909-48cf-8218-128b2a7de4aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:51:03 user nova-compute[74261]: No targets found.
Oct 17 11:51:03 user nova-compute[74261]: iSNS:
Oct 17 11:51:03 user nova-compute[74261]: No targets found.
Oct 17 11:51:03 user nova-compute[74261]: STATIC:
Oct 17 11:51:03 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:51:03 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:03 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:03 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:51:03 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:03 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:03 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487
Oct 17 11:51:03 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:03 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:03 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:51:03 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:03 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:03 user nova-compute[74261]: FIRMWARE:
Oct 17 11:51:03 user nova-compute[74261]: No targets found.
Oct 17 11:51:03 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:51:03 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:51:03 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1378f4-65ae-4996-9bec-5ffe0bb2f19c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0b0af1-943d-4bae-98fc-7cc9f539a0ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:51:03 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:03 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:03 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:03 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 (non-flash)
Oct 17 11:51:03 user nova-compute[74261]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:03 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:03 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:03 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c191bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:51:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance destroyed successfully.
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a3cf9-603e-4378-8713-ed6bb2d372a9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: 84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2be65-15fb-47b5-aee7-5ec555b4dcba]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc3c77-9902-4b98-bd13-008c86f78a33]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-84afda7e-7967-4683-9d57-7c83dc392312. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port 84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ee4b70bb-7d72-4e77-b084-e318824dfa7f tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.211s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db6d7db-c489-4730-a0f5-b0f3b0877b0e]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf59d564-97ae-4bd4-b074-3a8afdb47d03]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9f2c4-9fed-416d-8397-f49711378f25]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260]
Oct 17 11:51:03 user nova-compute[74261]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:03 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e409f6a-94c2-4649-a458-7b85b4d00487 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc39a74-2f73-4a1d-9a08-01c3384306cf]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.549s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] <== disconnect_volume: return (552ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6bec8fa6-15c5-4a83-b2b2-5bcdf8dd44aa req-4342158b-ace3-41a6-b417-7b56cc44cdf0 service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-e2c3d49f-f0a5-462b-ab44-6e9c5d6246a4 req-488dce33-6506-44e4-83b2-e70d479d0744 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2c3d49f-f0a5-462b-ab44-6e9c5d6246a4 req-488dce33-6506-44e4-83b2-e70d479d0744 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2c3d49f-f0a5-462b-ab44-6e9c5d6246a4 req-488dce33-6506-44e4-83b2-e70d479d0744 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e2c3d49f-f0a5-462b-ab44-6e9c5d6246a4 req-488dce33-6506-44e4-83b2-e70d479d0744 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-e2c3d49f-f0a5-462b-ab44-6e9c5d6246a4 req-488dce33-6506-44e4-83b2-e70d479d0744 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:51:04 user nova-compute[74261]: WARNING nova.compute.manager [req-e2c3d49f-f0a5-462b-ab44-6e9c5d6246a4 req-488dce33-6506-44e4-83b2-e70d479d0744 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state stopped and task_state None.
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-ea1f42aa-e5d8-4b29-ba47-871755d85574. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'flavor' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c9171369-e45d-4a74-95a7-8f011461d43b tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.670s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-89ad5517-bba1-4473-a23d-5f21ab429ecc req-0c29fa25-d4b1-4150-9224-8151b3420691 service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: 9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:06 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: 27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG nova.network.neutron [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port 9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG nova.network.neutron [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-27895229-c4a0-4e7f-9e1f-140ebf689277. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port 27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:08 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:51:08 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7031MB free_disk=25.38083267211914GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f07110f1-a355-47f2-9243-620b6ca41584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a8ffb39b-874a-484d-9171-293bf5245fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0b77d95-170b-40bb-9336-3c0afa66e1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 47c78622-6d42-43a6-93bb-298210ae07dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c1eee977-7ed6-441d-a103-d9c405bb46c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:51:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d908eb4d-96e1-43a7-b7e6-aaddc170666d req-c5bc0b40-4582-4181-a43a-b8172deefc1f service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-a9cdb9d3-8b59-4a92-8390-f28a747e5b43. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Successfully updated port: 78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-ec778c2c-a321-45f2-ba29-7bf336bd4286. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG nova.network.neutron [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG nova.network.neutron [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e5930677-814e-456f-93e4-1c4de5e2fe1d req-5a12c163-31ba-4637-bcff-c8aad7a5f913 service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG nova.objects.instance [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'flavor' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-78070ea8-d7a7-4f7a-b584-6f1144412516. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:11 user nova-compute[74261]: INFO nova.compute.manager [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Attaching volume cc845800-a79c-4d34-9c7d-8a46d04307f8 to /dev/vdb
Oct 17 11:51:12 user nova-compute[74261]: DEBUG os_brick.utils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1507e3c3-e2b6-4cbf-a4cb-86aec75e7665]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87acc9c5-fb32-4e5d-bfee-c3f3b5791a67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26a6d79-ae77-4150-9691-4476b593c13b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0838d587-9781-4c14-9bd0-cf01c09363d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:51:12 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef5dcf5-7066-497a-aa0b-231ccebf43bd]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG os_brick.utils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating existing volume attachment record: bb22e486-b67d-4df0-b0eb-02cecdbf0dba {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [{"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance network_info: |[{"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port 78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updated VIF entry in instance network info cache for port 78070ea8-d7a7-4f7a-b584-6f1144412516. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:51:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [{"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b71a4938-31a6-42d5-8d7d-01c83e1db510 req-1faddd30-b2fe-40f8-bc91-8f7e0c1c725e service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:18 user nova-compute[74261]: INFO nova.virt.block_device [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Booting with volume b501dad5-4475-49bf-bdf6-fb0372d13a4a at /dev/vdb
Oct 17 11:51:18 user nova-compute[74261]: DEBUG os_brick.utils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ed610-8fe5-4185-b4e6-b50b8009aad5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cabde-23c4-4e7a-817e-cd2f0eabeb97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf7d7f2-9588-4cdb-b489-c2360cd6ae3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e8ee4-e291-4b75-94cd-2fca2009ea31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:51:18 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:51:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d27cefe-6aa6-4c85-90e6-874a48023260]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG os_brick.utils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:18 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating existing volume attachment record: 8d150232-2cf5-4ebd-aa81-2a22df8a7c44 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:51:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:29 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:29 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:29 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb6d83e-36d7-46fc-a82e-c3a97113f5f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:51:29 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8228d-0a73-4872-8636-6b9ba2b91cfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8] added
Oct 17 11:51:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4eef2f-7ff0-402d-a43f-e6f2b41871b8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf726d41-6646-4061-b953-dd4ed746277a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTtColfu {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTtColfu" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c20e0c7-ef3c-4c29-9d81-146eeb11cf21]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTtColfu'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26c30f-a3d8-4577-a33d-28c5fafd3d59]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5904144b-6c75-44f6-8912-984094fdb391]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:29 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:29 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:29 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:29 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d6174-067a-4e76-ba74-569b44c20080]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]
Oct 17 11:51:30 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:30 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5ddc3e-20a3-4395-8ed9-86b25d5f17f1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb29f80-b59c-4606-9635-07c116cbb7ad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:30 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:30 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:30 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:30 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:30 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:30 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:30 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:30 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a185a5-4b65-4a19-ab1a-78ff922099dc]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:51:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23766366439643964', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766366439643964', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG nova.objects.instance [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'flavor' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:51:31 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:51:31 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 11:51:31 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:51:31 user nova-compute[74261]:   <serial>cc845800-a79c-4d34-9c7d-8a46d04307f8</serial>
Oct 17 11:51:31 user nova-compute[74261]: </disk>
Oct 17 11:51:31 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No VIF found with MAC fa:16:3e:12:7a:2d, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:51:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-501786d6-5a90-4fcc-949a-be2e2d2fb263 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.739s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:32 user nova-compute[74261]: INFO nova.compute.manager [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Terminating instance
Oct 17 11:51:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-e09d3c8c-2291-4059-9cd0-8d81f5c8f7e8 req-ca27c5ed-00ec-4cfd-925b-71613b19e46b service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e09d3c8c-2291-4059-9cd0-8d81f5c8f7e8 req-ca27c5ed-00ec-4cfd-925b-71613b19e46b service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e09d3c8c-2291-4059-9cd0-8d81f5c8f7e8 req-ca27c5ed-00ec-4cfd-925b-71613b19e46b service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e09d3c8c-2291-4059-9cd0-8d81f5c8f7e8 req-ca27c5ed-00ec-4cfd-925b-71613b19e46b service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-e09d3c8c-2291-4059-9cd0-8d81f5c8f7e8 req-ca27c5ed-00ec-4cfd-925b-71613b19e46b service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:51:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-e09d3c8c-2291-4059-9cd0-8d81f5c8f7e8 req-ca27c5ed-00ec-4cfd-925b-71613b19e46b service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-unplugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:51:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Instance destroyed successfully.
Oct 17 11:51:33 user nova-compute[74261]: DEBUG nova.objects.instance [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lazy-loading 'resources' on Instance uuid f07110f1-a355-47f2-9243-620b6ca41584 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-103165328',display_name='tempest-ServerStableDeviceRescueTest-server-103165328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-103165328',id=4,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlEf7+UCLSnqPt4PKh90e106AvNKjFXQiuFNpfY7AvzpEigsAoqR2ZVklvDCW0gT2Po9SnkkBWVgCY3j/+bYFs8wuzd1kue6eGFu2ZmzTtUhUJm/SvDqwbrwYXwtBsatQ==',key_name='tempest-keypair-120172596',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:48:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d586c830e4974cb8b3fcb758675e7014',ramdisk_id='',reservation_id='r-495hwwnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-895463564',owner_user_name='tempest-ServerStableDeviceRescueTest-895463564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:50:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68be85de4b2e4f4d8ac32f8e62abda04',uuid=f07110f1-a355-47f2-9243-620b6ca41584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converting VIF {"id": "7f10f299-2636-4403-80bf-e128689cdc4e", "address": "fa:16:3e:38:0c:0e", "network": {"id": "53d5e06f-784c-409e-9ccf-4fd290db7d64", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504154761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d586c830e4974cb8b3fcb758675e7014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f10f299-26", "ovs_interfaceid": "7f10f299-2636-4403-80bf-e128689cdc4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG os_vif [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f10f299-26, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3949a3d-fd66-44c7-b1f3-295a0e5e8eaf) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:33 user nova-compute[74261]: INFO os_vif [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=7f10f299-2636-4403-80bf-e128689cdc4e,network=Network(53d5e06f-784c-409e-9ccf-4fd290db7d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f10f299-26')
Oct 17 11:51:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Deleting instance files /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584_del
Oct 17 11:51:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Deletion of /opt/stack/data/nova/instances/f07110f1-a355-47f2-9243-620b6ca41584_del complete
Oct 17 11:51:33 user nova-compute[74261]: INFO nova.compute.manager [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 17 11:51:33 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:51:33 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:34 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Took 0.67 seconds to deallocate network for instance.
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:34 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Deleted allocations for instance f07110f1-a355-47f2-9243-620b6ca41584
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-728a0bb8-f5b7-4d4c-b631-557ee601cdd8 tempest-ServerStableDeviceRescueTest-895463564 tempest-ServerStableDeviceRescueTest-895463564-project-member] Lock "f07110f1-a355-47f2-9243-620b6ca41584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] Acquiring lock "f07110f1-a355-47f2-9243-620b6ca41584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] Lock "f07110f1-a355-47f2-9243-620b6ca41584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] No waiting events found dispatching network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:51:34 user nova-compute[74261]: WARNING nova.compute.manager [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received unexpected event network-vif-plugged-7f10f299-2636-4403-80bf-e128689cdc4e for instance with vm_state deleted and task_state None.
Oct 17 11:51:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-c29994ed-8cce-4724-9a16-e498df5b3295 req-b02366f9-3d6d-417f-8ce9-1d58964c7bdd service nova] [instance: f07110f1-a355-47f2-9243-620b6ca41584] Received event network-vif-deleted-7f10f299-2636-4403-80bf-e128689cdc4e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:36 user nova-compute[74261]: INFO nova.virt.block_device [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Booting with volume a070e7cb-9abe-41df-a7a8-a71a25fd5d20 at /dev/vdc
Oct 17 11:51:36 user nova-compute[74261]: DEBUG os_brick.utils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf4c9f-2c5f-48f0-a8ad-acbc9124870e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab461e-8608-4e98-a6a2-52c7c4b6f0a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45e5101-79b9-4d0f-8119-232560baf96e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86697c2-af60-46c5-b8f1-1459c8df714d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:51:36 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:51:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8e874-7d64-407d-9f41-9e9d3a309310]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG os_brick.utils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:36 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating existing volume attachment record: 6b83a889-7afc-449e-9203-be6e1353a678 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:51:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-changed-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing instance network info cache due to event network-changed-56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing network info cache for port 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updated VIF entry in instance network info cache for port 56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:51:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d76ef962-d5a6-4b0c-bdd1-88a0f7025082 req-1e28cf07-2196-45e4-8936-7ab616438ee9 service nova] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-changed-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing instance network info cache due to event network-changed-56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing network info cache for port 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updated VIF entry in instance network info cache for port 56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4cc4ee8-634b-4535-be03-c42fb70c6dc2 req-db78299f-3088-429d-b58a-eb1dd0df2d2b service nova] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:51:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Creating image(s)
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Ensure instance console log exists: /opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Start _get_guest_xml network_info=[{"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '054e8eae-4792-4a9a-9521-4bdc6586e852', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYchoSjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1eee977-7ed6-441d-a103-d9c405bb46c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa100a5d-910d-48c2-8a43-911c402fd074', 'serial': 'aa100a5d-910d-48c2-8a43-911c402fd074'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'attachment_id': '8d150232-2cf5-4ebd-aa81-2a22df8a7c44', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwuezmIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1eee977-7ed6-441d-a103-d9c405bb46c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b501dad5-4475-49bf-bdf6-fb0372d13a4a', 'serial': 'b501dad5-4475-49bf-bdf6-fb0372d13a4a'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'attachment_id': '6b83a889-7afc-449e-9203-be6e1353a678', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHkeXxBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1eee977-7ed6-441d-a103-d9c405bb46c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a070e7cb-9abe-41df-a7a8-a71a25fd5d20', 'serial': 'a070e7cb-9abe-41df-a7a8-a71a25fd5d20'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:51:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:51:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYchoSjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:54 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f29c65-bc21-4c31-82ef-166d82ccb1af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:51:54 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9602c5de-3e75-4376-8b42-36fec5a927b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074] added
Oct 17 11:51:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf304f8-f42f-4b4d-aec7-783f96217c72]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[698f61c3-2949-41db-b871-06d9493b9006]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYchoSjR {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYchoSjR" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f9805f-9937-46ce-b6cc-5801d991e686]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QYchoSjR'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[495d0206-b818-4c55-a24a-1cd18b9494b1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6fb92-b0e2-4149-876c-708abdbfecb3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d1a7fe-1ab5-4fda-9113-74a242f79174]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260]
Oct 17 11:51:55 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d5eb2-03ce-49db-8e16-1c98ff20e26c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cdcdc4-8375-45dc-8f56-4bcf5ebb147c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dc1dbe-d0fa-477a-a4ad-3bf7bc7960b6]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYchoSjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:55 user nova-compute[74261]: INFO nova.compute.manager [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Rebooting instance
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:51:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23865626333326466', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865626333326466', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwuezmIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:56 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:56 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:56 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84ca663-1671-428d-98ee-5cfb498e3680]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:51:56 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e571473-0627-4382-900e-8a6131f99632]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a] added
Oct 17 11:51:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ed439-4983-464b-b2b1-4d05d8635288]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea112ec-515f-4c40-aa14-f71c89b5c075]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwuezmIa {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwuezmIa" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9368da-9db1-4818-bc5a-0d54a3cdb62b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WwuezmIa'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3b7b96-9982-4be4-95ec-a28a72ec1b02]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e36e1-657e-42be-8030-3d529a3d4249]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f51102f-0c80-4cef-8e10-35754ea6b91a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260]
Oct 17 11:51:56 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e117b3c0-c1f7-4c8b-bf42-b91e75f23533]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[569b82eb-34e0-42c2-a0b7-eca2ff56ad0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:56 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a32490-02ae-4426-b424-92c98d8c323a]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwuezmIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-4f3cba67-6fb9-4870-a925-46f38d2680b6 req-fbc55d5e-f618-46ba-b638-16f1b68d58b0 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-unplugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4f3cba67-6fb9-4870-a925-46f38d2680b6 req-fbc55d5e-f618-46ba-b638-16f1b68d58b0 service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4f3cba67-6fb9-4870-a925-46f38d2680b6 req-fbc55d5e-f618-46ba-b638-16f1b68d58b0 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4f3cba67-6fb9-4870-a925-46f38d2680b6 req-fbc55d5e-f618-46ba-b638-16f1b68d58b0 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-4f3cba67-6fb9-4870-a925-46f38d2680b6 req-fbc55d5e-f618-46ba-b638-16f1b68d58b0 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-unplugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:51:57 user nova-compute[74261]: WARNING nova.compute.manager [req-4f3cba67-6fb9-4870-a925-46f38d2680b6 req-fbc55d5e-f618-46ba-b638-16f1b68d58b0 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-unplugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state active and task_state reboot_started_hard.
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance destroyed successfully.
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'resources' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-660772241',display_name='tempest-TestMinimumBasicScenario-server-660772241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-660772241',id=18,image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvoviKmRIWLhqx1/0v54FSfhcp38or1tfFwWW/M7aAdE030sOCxjF+2q5LfNWRzejEDrBKjI2pSldCHUoHdnMS81oeOCXOZ514/oXtGkD5pZKslf2vHEGeAmqjHXeQE0w==',key_name='tempest-TestMinimumBasicScenario-139334831',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-8ku7ekcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:51:57Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=f0b77d95-170b-40bb-9336-3c0afa66e1df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56109d31-79, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcde6547-986f-45cf-992a-ee8be2d1caaa) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:57 user nova-compute[74261]: INFO os_vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79')
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23139336637336633', 'path': '/dev/sdg'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139336637336633', 'path': '/dev/sdg'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.070s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHkeXxBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee3506-a2ef-4dbb-b778-1bbf20f81e95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:51:57 user nova-compute[74261]: No targets found.
Oct 17 11:51:57 user nova-compute[74261]: iSNS:
Oct 17 11:51:57 user nova-compute[74261]: No targets found.
Oct 17 11:51:57 user nova-compute[74261]: STATIC:
Oct 17 11:51:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:51:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074
Oct 17 11:51:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:51:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:51:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:51:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:51:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:51:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:51:57 user nova-compute[74261]: FIRMWARE:
Oct 17 11:51:57 user nova-compute[74261]: No targets found.
Oct 17 11:51:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:51:57 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:51:57 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d48180-2ed2-4039-8b04-ed48093f2892]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c79e2b-7e88-45da-8b65-37f4ce7dc061]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:57 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c191b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47262d7-0b72-49c0-9c4a-a8c779d2ec22]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a15e0f3-5878-44ea-a221-d9df695c1ac1]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e4d14a-a154-4dcf-aedc-8af4b161dde0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e14238-09a4-441e-89e9-11a9d1200c20]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619914e-453e-449b-8248-71a18c9ac22a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[395ec3a7-3123-45a0-8af9-712b7acdc920]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]
Oct 17 11:51:57 user nova-compute[74261]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[133ff36c-7abc-4587-81b6-d33fa4d11c9b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== disconnect_volume: return (391ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.298s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:58 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Start _get_guest_xml network_info=[{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09bedbee-5fc2-43c9-ab9e-42698c7b6c68,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '09bedbee-5fc2-43c9-ab9e-42698c7b6c68'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'bb22e486-b67d-4df0-b0eb-02cecdbf0dba', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f0b77d95-170b-40bb-9336-3c0afa66e1df', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc845800-a79c-4d34-9c7d-8a46d04307f8', 'serial': 'cc845800-a79c-4d34-9c7d-8a46d04307f8'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:51:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:51:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cae76b8-eff4-4eca-8a40-b02663cce321]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:51:58 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09bedbee-5fc2-43c9-ab9e-42698c7b6c68,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cab099-8545-4f90-8732-2f883d6559e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.objects.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Object Instance<f0b77d95-170b-40bb-9336-3c0afa66e1df> lazy-loaded attributes: resources,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:51:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20] added
Oct 17 11:51:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2b19e-b122-4de1-809f-c8ab892bcd7f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[202f6bc7-65c9-405e-b3d2-f2f7850d6ef0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHkeXxBV {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHkeXxBV" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba93d7ea-1980-4c17-a357-dd9166abf805]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gHkeXxBV'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be457af-326e-4414-885b-9692c3ea8725]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1515e7-2109-4395-9d01-2d8b34fe7168]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab22943-b5c4-4282-8879-816c88710737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260]
Oct 17 11:51:58 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ddd33-20be-4160-877b-4f7868639df6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b2bad-82bf-411f-860a-549589a38fb7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:58 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:51:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb28259-c6a5-419f-ad1a-f19fd22b15e1]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:51:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHkeXxBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== connect_volume: return (1659ms) {'type': 'block', 'scsi_wwn': '23839656236346664', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839656236346664', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.290s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:51:59 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-47d7f16d-7dd9-4aac-b1e3-ef7d95adf861 req-43d221bd-62ec-47e0-8e4b-42b1ca0c601e service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-47d7f16d-7dd9-4aac-b1e3-ef7d95adf861 req-43d221bd-62ec-47e0-8e4b-42b1ca0c601e service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-47d7f16d-7dd9-4aac-b1e3-ef7d95adf861 req-43d221bd-62ec-47e0-8e4b-42b1ca0c601e service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-47d7f16d-7dd9-4aac-b1e3-ef7d95adf861 req-43d221bd-62ec-47e0-8e4b-42b1ca0c601e service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-47d7f16d-7dd9-4aac-b1e3-ef7d95adf861 req-43d221bd-62ec-47e0-8e4b-42b1ca0c601e service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:51:59 user nova-compute[74261]: WARNING nova.compute.manager [req-47d7f16d-7dd9-4aac-b1e3-ef7d95adf861 req-43d221bd-62ec-47e0-8e4b-42b1ca0c601e service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state active and task_state reboot_started_hard.
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8036c52a-3072-487c-b222-39c93b4953a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:51:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lazy-loading 'pci_devices' on Instance uuid c1eee977-7ed6-441d-a103-d9c405bb46c2 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5edc5dc-710a-4fb8-8deb-dbddfd7cdc9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8] added
Oct 17 11:51:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:51:59 user nova-compute[74261]:   <uuid>c1eee977-7ed6-441d-a103-d9c405bb46c2</uuid>
Oct 17 11:51:59 user nova-compute[74261]:   <name>instance-00000016</name>
Oct 17 11:51:59 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:51:59 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:51:59 user nova-compute[74261]:   <metadata>
Oct 17 11:51:59 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:51:59 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:51:59 user nova-compute[74261]:       <nova:name>tempest-device-tagging-server-1484698494</nova:name>
Oct 17 11:51:59 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:51:54</nova:creationTime>
Oct 17 11:51:59 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:51:59 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:51:59 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:51:59 user nova-compute[74261]:       <nova:owner>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:user uuid="0f23a8928f3f471dab8b2942438b24a5">tempest-TaggedBootDevicesTest_v242-1437954569-project-member</nova:user>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:project uuid="e2f713455cc64f2590e5e714f50eb1fd">tempest-TaggedBootDevicesTest_v242-1437954569</nova:project>
Oct 17 11:51:59 user nova-compute[74261]:       </nova:owner>
Oct 17 11:51:59 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:51:59 user nova-compute[74261]:       <nova:ports>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="84afda7e-7967-4683-9d57-7c83dc392312">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="ea1f42aa-e5d8-4b29-ba47-871755d85574">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="27895229-c4a0-4e7f-9e1f-140ebf689277">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="a9cdb9d3-8b59-4a92-8390-f28a747e5b43">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="ec778c2c-a321-45f2-ba29-7bf336bd4286">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:         <nova:port uuid="78070ea8-d7a7-4f7a-b584-6f1144412516">
Oct 17 11:51:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 17 11:51:59 user nova-compute[74261]:         </nova:port>
Oct 17 11:51:59 user nova-compute[74261]:       </nova:ports>
Oct 17 11:51:59 user nova-compute[74261]:     </nova:instance>
Oct 17 11:51:59 user nova-compute[74261]:   </metadata>
Oct 17 11:51:59 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:51:59 user nova-compute[74261]:     <system>
Oct 17 11:51:59 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:51:59 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:51:59 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:51:59 user nova-compute[74261]:       <entry name="serial">c1eee977-7ed6-441d-a103-d9c405bb46c2</entry>
Oct 17 11:51:59 user nova-compute[74261]:       <entry name="uuid">c1eee977-7ed6-441d-a103-d9c405bb46c2</entry>
Oct 17 11:51:59 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:51:59 user nova-compute[74261]:     </system>
Oct 17 11:51:59 user nova-compute[74261]:   </sysinfo>
Oct 17 11:51:59 user nova-compute[74261]:   <os>
Oct 17 11:51:59 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:51:59 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:51:59 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:51:59 user nova-compute[74261]:   </os>
Oct 17 11:51:59 user nova-compute[74261]:   <features>
Oct 17 11:51:59 user nova-compute[74261]:     <acpi/>
Oct 17 11:51:59 user nova-compute[74261]:     <apic/>
Oct 17 11:51:59 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:51:59 user nova-compute[74261]:   </features>
Oct 17 11:51:59 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:51:59 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:51:59 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:51:59 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:51:59 user nova-compute[74261]:   </clock>
Oct 17 11:51:59 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:51:59 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:51:59 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:51:59 user nova-compute[74261]:   </cpu>
Oct 17 11:51:59 user nova-compute[74261]:   <devices>
Oct 17 11:51:59 user nova-compute[74261]:     <disk type="file" device="cdrom">
Oct 17 11:51:59 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 11:51:59 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2/disk.config"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="hda" bus="ide"/>
Oct 17 11:51:59 user nova-compute[74261]:     </disk>
Oct 17 11:51:59 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:51:59 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:51:59 user nova-compute[74261]:       <source dev="/dev/sdc"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <serial>aa100a5d-910d-48c2-8a43-911c402fd074</serial>
Oct 17 11:51:59 user nova-compute[74261]:     </disk>
Oct 17 11:51:59 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:51:59 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:51:59 user nova-compute[74261]:       <source dev="/dev/sdg"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <serial>b501dad5-4475-49bf-bdf6-fb0372d13a4a</serial>
Oct 17 11:51:59 user nova-compute[74261]:     </disk>
Oct 17 11:51:59 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:51:59 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:51:59 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="vdc" bus="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <serial>a070e7cb-9abe-41df-a7a8-a71a25fd5d20</serial>
Oct 17 11:51:59 user nova-compute[74261]:     </disk>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:45:27:da"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tap84afda7e-79"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:45:5f:6a"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tapea1f42aa-e5"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:a6:45:eb"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tap9e20fc8e-bc"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:b6:06:1f"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tap27895229-c4"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:3f:f3:08"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tapa9cdb9d3-8b"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:22:b2:a9"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tapec778c2c-a3"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:51:59 user nova-compute[74261]:       <mac address="fa:16:3e:fe:d1:df"/>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:51:59 user nova-compute[74261]:       <target dev="tap78070ea8-d7"/>
Oct 17 11:51:59 user nova-compute[74261]:     </interface>
Oct 17 11:51:59 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:51:59 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2/console.log" append="off"/>
Oct 17 11:51:59 user nova-compute[74261]:     </serial>
Oct 17 11:51:59 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:51:59 user nova-compute[74261]:     <video>
Oct 17 11:51:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:51:59 user nova-compute[74261]:     </video>
Oct 17 11:51:59 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:51:59 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:51:59 user nova-compute[74261]:     </rng>
Oct 17 11:51:59 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:51:59 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:51:59 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:51:59 user nova-compute[74261]:     </memballoon>
Oct 17 11:51:59 user nova-compute[74261]:   </devices>
Oct 17 11:51:59 user nova-compute[74261]: </domain>
Oct 17 11:51:59 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29403732-18b9-500e-91f0-ec8b9571bb26', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd6b0b-a4bd-4942-a03c-4eefe363bc55]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84afda7e-79, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84afda7e-79, col_values=(('qos', UUID('505fc9b7-f777-4b0f-b56f-e2959aa7aa9c')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84afda7e-79, col_values=(('external_ids', {'iface-id': '84afda7e-7967-4683-9d57-7c83dc392312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:27:da', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3889de-77f6-40da-b93b-1627bee38c67]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTtColfu {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79')
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be671274-bf77-50d6-b3ee-9c68e31dc4ac', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTtColfu" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7057f0-f1e3-42ad-933b-74ea75e72179]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTtColfu'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea1f42aa-e5, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea1f42aa-e5, col_values=(('qos', UUID('76c4acc6-3905-4257-8c94-6fef193a8f68')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea1f42aa-e5, col_values=(('external_ids', {'iface-id': 'ea1f42aa-e5d8-4b29-ba47-871755d85574', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:5f:6a', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[112066aa-40db-40f9-9df9-2a88f92e6e25]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5')
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daee5ef-95b3-44d2-baa4-7d1f7d6a674d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2448a474-75ec-53be-bb54-3eb01ff24868', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e20fc8e-bc, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e20fc8e-bc, col_values=(('qos', UUID('7ba68fde-eec6-4970-9a01-a2727ce9a367')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e20fc8e-bc, col_values=(('external_ids', {'iface-id': '9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:45:eb', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3adaf-fa5a-4776-b618-f41587326447]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]
Oct 17 11:51:59 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.
Oct 17 11:51:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc')
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eda33b36-8aa3-51dc-abf8-9e2c4cafc8ba', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[45474e12-ac8b-461b-909e-0d3ec5ccdf04]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27895229-c4, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27895229-c4, col_values=(('qos', UUID('98c18420-3b78-405f-a85f-62a611970b7d')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27895229-c4, col_values=(('external_ids', {'iface-id': '27895229-c4a0-4e7f-9e1f-140ebf689277', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:06:1f', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5d1f06-d930-4777-b9a3-701d937decd2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:51:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370b6f5-1504-4bcf-bcdd-95c5c379b6bd]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4')
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75a3f04e-e82d-54fc-87a6-e3e0dfc687b6', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9cdb9d3-8b, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9cdb9d3-8b, col_values=(('qos', UUID('024a5456-c226-48bd-92a7-018d59d889e4')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9cdb9d3-8b, col_values=(('external_ids', {'iface-id': 'a9cdb9d3-8b59-4a92-8390-f28a747e5b43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:f3:08', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b')
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29229a7a-250f-553a-a1b9-c26c299f8843', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec778c2c-a3, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:51:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec778c2c-a3, col_values=(('qos', UUID('fa0646e4-1617-44f8-8207-ab2387b26fb1')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec778c2c-a3, col_values=(('external_ids', {'iface-id': 'ec778c2c-a321-45f2-ba29-7bf336bd4286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:b2:a9', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3')
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49651c41-144e-5bd5-8a27-d64807d26b1e', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78070ea8-d7, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78070ea8-d7, col_values=(('qos', UUID('83784229-83fd-4303-82be-ba7d275af4fa')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78070ea8-d7, col_values=(('external_ids', {'iface-id': '78070ea8-d7a7-4f7a-b584-6f1144412516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:d1:df', 'vm-uuid': 'c1eee977-7ed6-441d-a103-d9c405bb46c2'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:00 user nova-compute[74261]: INFO os_vif [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7')
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] No BDM found with device name hda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] No VIF found with MAC fa:16:3e:45:27:da, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] No VIF found with MAC fa:16:3e:3f:f3:08, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:52:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Using config drive
Oct 17 11:52:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Creating config drive at /opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2/disk.config
Oct 17 11:52:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzb7a4831 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzb7a4831" returned: 0 in 0.064s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== connect_volume: return (2680ms) {'type': 'block', 'scsi_wwn': '23766366439643964', 'path': '/dev/sdh'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766366439643964', 'path': '/dev/sdh'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-660772241',display_name='tempest-TestMinimumBasicScenario-server-660772241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-660772241',id=18,image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvoviKmRIWLhqx1/0v54FSfhcp38or1tfFwWW/M7aAdE030sOCxjF+2q5LfNWRzejEDrBKjI2pSldCHUoHdnMS81oeOCXOZ514/oXtGkD5pZKslf2vHEGeAmqjHXeQE0w==',key_name='tempest-TestMinimumBasicScenario-139334831',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-8ku7ekcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:51:57Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=f0b77d95-170b-40bb-9336-3c0afa66e1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'pci_devices' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.objects.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Object Instance<f0b77d95-170b-40bb-9336-3c0afa66e1df> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:52:00 user nova-compute[74261]:   <uuid>f0b77d95-170b-40bb-9336-3c0afa66e1df</uuid>
Oct 17 11:52:00 user nova-compute[74261]:   <name>instance-00000012</name>
Oct 17 11:52:00 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:52:00 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:52:00 user nova-compute[74261]:   <metadata>
Oct 17 11:52:00 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:52:00 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:52:00 user nova-compute[74261]:       <nova:name>tempest-TestMinimumBasicScenario-server-660772241</nova:name>
Oct 17 11:52:00 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:51:58</nova:creationTime>
Oct 17 11:52:00 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:52:00 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:52:00 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:52:00 user nova-compute[74261]:       <nova:owner>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:user uuid="4bfbfaa0fb2f4f7fbcdd7f8b98d784f9">tempest-TestMinimumBasicScenario-1183526091-project-member</nova:user>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:project uuid="f0813d99c95c47adb2b92394341409e8">tempest-TestMinimumBasicScenario-1183526091</nova:project>
Oct 17 11:52:00 user nova-compute[74261]:       </nova:owner>
Oct 17 11:52:00 user nova-compute[74261]:       <nova:root type="image" uuid="09bedbee-5fc2-43c9-ab9e-42698c7b6c68"/>
Oct 17 11:52:00 user nova-compute[74261]:       <nova:ports>
Oct 17 11:52:00 user nova-compute[74261]:         <nova:port uuid="56109d31-799c-49e5-8609-5455df819324">
Oct 17 11:52:00 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 17 11:52:00 user nova-compute[74261]:         </nova:port>
Oct 17 11:52:00 user nova-compute[74261]:       </nova:ports>
Oct 17 11:52:00 user nova-compute[74261]:     </nova:instance>
Oct 17 11:52:00 user nova-compute[74261]:   </metadata>
Oct 17 11:52:00 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:52:00 user nova-compute[74261]:     <system>
Oct 17 11:52:00 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:52:00 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:52:00 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:52:00 user nova-compute[74261]:       <entry name="serial">f0b77d95-170b-40bb-9336-3c0afa66e1df</entry>
Oct 17 11:52:00 user nova-compute[74261]:       <entry name="uuid">f0b77d95-170b-40bb-9336-3c0afa66e1df</entry>
Oct 17 11:52:00 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:52:00 user nova-compute[74261]:     </system>
Oct 17 11:52:00 user nova-compute[74261]:   </sysinfo>
Oct 17 11:52:00 user nova-compute[74261]:   <os>
Oct 17 11:52:00 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:52:00 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:52:00 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:52:00 user nova-compute[74261]:   </os>
Oct 17 11:52:00 user nova-compute[74261]:   <features>
Oct 17 11:52:00 user nova-compute[74261]:     <acpi/>
Oct 17 11:52:00 user nova-compute[74261]:     <apic/>
Oct 17 11:52:00 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:52:00 user nova-compute[74261]:   </features>
Oct 17 11:52:00 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:52:00 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:52:00 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:52:00 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:52:00 user nova-compute[74261]:   </clock>
Oct 17 11:52:00 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:52:00 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:52:00 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:52:00 user nova-compute[74261]:   </cpu>
Oct 17 11:52:00 user nova-compute[74261]:   <devices>
Oct 17 11:52:00 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:52:00 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:52:00 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk"/>
Oct 17 11:52:00 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:52:00 user nova-compute[74261]:     </disk>
Oct 17 11:52:00 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:52:00 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:52:00 user nova-compute[74261]:       <source dev="/dev/sdh"/>
Oct 17 11:52:00 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:52:00 user nova-compute[74261]:       <serial>cc845800-a79c-4d34-9c7d-8a46d04307f8</serial>
Oct 17 11:52:00 user nova-compute[74261]:     </disk>
Oct 17 11:52:00 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:52:00 user nova-compute[74261]:       <mac address="fa:16:3e:12:7a:2d"/>
Oct 17 11:52:00 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:52:00 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:52:00 user nova-compute[74261]:       <target dev="tap56109d31-79"/>
Oct 17 11:52:00 user nova-compute[74261]:     </interface>
Oct 17 11:52:00 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:52:00 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/console.log" append="off"/>
Oct 17 11:52:00 user nova-compute[74261]:     </serial>
Oct 17 11:52:00 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:52:00 user nova-compute[74261]:     <video>
Oct 17 11:52:00 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:52:00 user nova-compute[74261]:     </video>
Oct 17 11:52:00 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:52:00 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:52:00 user nova-compute[74261]:     </rng>
Oct 17 11:52:00 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:52:00 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:52:00 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:52:00 user nova-compute[74261]:     </memballoon>
Oct 17 11:52:00 user nova-compute[74261]:   </devices>
Oct 17 11:52:00 user nova-compute[74261]: </domain>
Oct 17 11:52:00 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.objects.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Object Instance<f0b77d95-170b-40bb-9336-3c0afa66e1df> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Cannot resize image /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'migration_context' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.objects.base [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Object Instance<f0b77d95-170b-40bb-9336-3c0afa66e1df> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-660772241',display_name='tempest-TestMinimumBasicScenario-server-660772241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-660772241',id=18,image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvoviKmRIWLhqx1/0v54FSfhcp38or1tfFwWW/M7aAdE030sOCxjF+2q5LfNWRzejEDrBKjI2pSldCHUoHdnMS81oeOCXOZ514/oXtGkD5pZKslf2vHEGeAmqjHXeQE0w==',key_name='tempest-TestMinimumBasicScenario-139334831',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-8ku7ekcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:51:57Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=f0b77d95-170b-40bb-9336-3c0afa66e1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG os_vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ffcbfcf-30ba-56f4-9c87-279f52fbad1e', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56109d31-79, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56109d31-79, col_values=(('qos', UUID('53e688bf-a72a-4c9b-8bd6-97f181c093c3')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56109d31-79, col_values=(('external_ids', {'iface-id': '56109d31-799c-49e5-8609-5455df819324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:7a:2d', 'vm-uuid': 'f0b77d95-170b-40bb-9336-3c0afa66e1df'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:01 user nova-compute[74261]: INFO os_vif [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79')
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-55c2df71-b9a8-4bd8-a569-62c315df30cb req-f0a9d5bb-e3c6-42f4-b7ba-a6cccf8860e6 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-55c2df71-b9a8-4bd8-a569-62c315df30cb req-f0a9d5bb-e3c6-42f4-b7ba-a6cccf8860e6 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-55c2df71-b9a8-4bd8-a569-62c315df30cb req-f0a9d5bb-e3c6-42f4-b7ba-a6cccf8860e6 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-55c2df71-b9a8-4bd8-a569-62c315df30cb req-f0a9d5bb-e3c6-42f4-b7ba-a6cccf8860e6 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-55c2df71-b9a8-4bd8-a569-62c315df30cb req-f0a9d5bb-e3c6-42f4-b7ba-a6cccf8860e6 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:03 user nova-compute[74261]: WARNING nova.compute.manager [req-55c2df71-b9a8-4bd8-a569-62c315df30cb req-f0a9d5bb-e3c6-42f4-b7ba-a6cccf8860e6 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 for instance with vm_state building and task_state spawning.
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-f65feb91-9fd5-4545-8e2d-2d899888466e req-3723fe37-fdb5-4358-acb0-e88d81c57a9b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f65feb91-9fd5-4545-8e2d-2d899888466e req-3723fe37-fdb5-4358-acb0-e88d81c57a9b service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f65feb91-9fd5-4545-8e2d-2d899888466e req-3723fe37-fdb5-4358-acb0-e88d81c57a9b service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f65feb91-9fd5-4545-8e2d-2d899888466e req-3723fe37-fdb5-4358-acb0-e88d81c57a9b service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-f65feb91-9fd5-4545-8e2d-2d899888466e req-3723fe37-fdb5-4358-acb0-e88d81c57a9b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:03 user nova-compute[74261]: WARNING nova.compute.manager [req-f65feb91-9fd5-4545-8e2d-2d899888466e req-3723fe37-fdb5-4358-acb0-e88d81c57a9b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd for instance with vm_state building and task_state spawning.
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a76fb50-ae8d-4109-a294-2fad24cb3899 req-9ca8877f-3bd9-457b-a41e-3f05dd0945f2 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a76fb50-ae8d-4109-a294-2fad24cb3899 req-9ca8877f-3bd9-457b-a41e-3f05dd0945f2 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a76fb50-ae8d-4109-a294-2fad24cb3899 req-9ca8877f-3bd9-457b-a41e-3f05dd0945f2 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a76fb50-ae8d-4109-a294-2fad24cb3899 req-9ca8877f-3bd9-457b-a41e-3f05dd0945f2 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a76fb50-ae8d-4109-a294-2fad24cb3899 req-9ca8877f-3bd9-457b-a41e-3f05dd0945f2 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:05 user nova-compute[74261]: WARNING nova.compute.manager [req-7a76fb50-ae8d-4109-a294-2fad24cb3899 req-9ca8877f-3bd9-457b-a41e-3f05dd0945f2 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 for instance with vm_state building and task_state spawning.
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-eb2b6c9e-3ce6-4116-86ca-17b343e90afb req-e33d5a71-aeed-4d3b-be21-c63df2091772 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eb2b6c9e-3ce6-4116-86ca-17b343e90afb req-e33d5a71-aeed-4d3b-be21-c63df2091772 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eb2b6c9e-3ce6-4116-86ca-17b343e90afb req-e33d5a71-aeed-4d3b-be21-c63df2091772 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eb2b6c9e-3ce6-4116-86ca-17b343e90afb req-e33d5a71-aeed-4d3b-be21-c63df2091772 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-eb2b6c9e-3ce6-4116-86ca-17b343e90afb req-e33d5a71-aeed-4d3b-be21-c63df2091772 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:05 user nova-compute[74261]: WARNING nova.compute.manager [req-eb2b6c9e-3ce6-4116-86ca-17b343e90afb req-e33d5a71-aeed-4d3b-be21-c63df2091772 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd for instance with vm_state building and task_state spawning.
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-10bb3d74-4382-42b4-a92e-79dfeb5a632b req-fc9a8300-ae25-4f18-84e8-6cebde4824dc service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-10bb3d74-4382-42b4-a92e-79dfeb5a632b req-fc9a8300-ae25-4f18-84e8-6cebde4824dc service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-10bb3d74-4382-42b4-a92e-79dfeb5a632b req-fc9a8300-ae25-4f18-84e8-6cebde4824dc service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-10bb3d74-4382-42b4-a92e-79dfeb5a632b req-fc9a8300-ae25-4f18-84e8-6cebde4824dc service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-10bb3d74-4382-42b4-a92e-79dfeb5a632b req-fc9a8300-ae25-4f18-84e8-6cebde4824dc service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:07 user nova-compute[74261]: WARNING nova.compute.manager [req-10bb3d74-4382-42b4-a92e-79dfeb5a632b req-fc9a8300-ae25-4f18-84e8-6cebde4824dc service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 for instance with vm_state building and task_state spawning.
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:52:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance rebooted successfully.
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f49e0f86-2242-429a-974a-b1a5b1f92c97 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 11.938s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:52:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance spawned successfully.
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:08 user nova-compute[74261]: INFO nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Took 13.35 seconds to spawn the instance on the hypervisor.
Oct 17 11:52:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:08 user nova-compute[74261]: INFO nova.compute.manager [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Took 71.70 seconds to build instance.
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-950a4122-ddc0-4537-bf03-e04cc06d1aa1 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 72.071s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:09 user nova-compute[74261]: WARNING nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 for instance with vm_state active and task_state None.
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:09 user nova-compute[74261]: WARNING nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 for instance with vm_state active and task_state None.
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:09 user nova-compute[74261]: WARNING nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 for instance with vm_state active and task_state None.
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:09 user nova-compute[74261]: WARNING nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state active and task_state None.
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:09 user nova-compute[74261]: WARNING nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state active and task_state None.
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:09 user nova-compute[74261]: WARNING nova.compute.manager [req-4a2ad43e-0737-4487-a57c-e5e8d993a8bf req-d0c4d45e-9674-4fe1-8ed1-8a37b0a1b8ff service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 for instance with vm_state active and task_state None.
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:11 user nova-compute[74261]: WARNING nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 for instance with vm_state active and task_state None.
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:11 user nova-compute[74261]: WARNING nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 for instance with vm_state active and task_state None.
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:11 user nova-compute[74261]: WARNING nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 for instance with vm_state active and task_state None.
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:11 user nova-compute[74261]: WARNING nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 for instance with vm_state active and task_state None.
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:11 user nova-compute[74261]: WARNING nova.compute.manager [req-2cc785f2-c887-43dc-bd1b-a07f82070ef3 req-9febca4d-753a-4475-ba18-b041c186ee28 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 for instance with vm_state active and task_state None.
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:52:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:52:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7184MB free_disk=25.41769790649414GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 6873f406-8c93-4d9d-b0d5-92296614b94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a8ffb39b-874a-484d-9171-293bf5245fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0b77d95-170b-40bb-9336-3c0afa66e1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 47c78622-6d42-43a6-93bb-298210ae07dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c1eee977-7ed6-441d-a103-d9c405bb46c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:52:12 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-changed-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Refreshing instance network info cache due to event network-changed-28011a4c-3b68-47de-a6cb-af96182da3e3. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] Acquiring lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] Acquired lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Refreshing network info cache for port 28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updated VIF entry in instance network info cache for port 28011a4c-3b68-47de-a6cb-af96182da3e3. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating instance_info_cache with network_info: [{"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-be20a7ec-838a-48bb-b5dd-e45db22ae7ca req-da447c83-d5b6-4f05-bc55-120787782226 service nova] Releasing lock "refresh_cache-408f6bb4-f944-4043-8e61-a62ac7d49938" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:52:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid f0f6a950-d984-4ece-9a20-134bf800db37 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:14 user nova-compute[74261]: INFO nova.compute.manager [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Rebuilding instance
Oct 17 11:52:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-9b75d121-1e77-41c2-986f-c86b2c2fc79f req-12b8ef8d-4dd4-4504-95ff-60d8b74a9c4b service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9b75d121-1e77-41c2-986f-c86b2c2fc79f req-12b8ef8d-4dd4-4504-95ff-60d8b74a9c4b service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9b75d121-1e77-41c2-986f-c86b2c2fc79f req-12b8ef8d-4dd4-4504-95ff-60d8b74a9c4b service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9b75d121-1e77-41c2-986f-c86b2c2fc79f req-12b8ef8d-4dd4-4504-95ff-60d8b74a9c4b service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-9b75d121-1e77-41c2-986f-c86b2c2fc79f req-12b8ef8d-4dd4-4504-95ff-60d8b74a9c4b service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:15 user nova-compute[74261]: WARNING nova.compute.manager [req-9b75d121-1e77-41c2-986f-c86b2c2fc79f req-12b8ef8d-4dd4-4504-95ff-60d8b74a9c4b service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state rebuilding.
Oct 17 11:52:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance destroyed successfully.
Oct 17 11:52:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance destroyed successfully.
Oct 17 11:52:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424524728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-669144641',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe0H6TYJKtnM5UZxmp/5bHuEIzV0OVEDrIFCPQDY/SO41uj9ABVdiu5V1E6uGlhC8TuUzI7/t4NohLrqHWMbM7ORBEcE9rrb6hRtwcufBsxZzn5h8m8f0JBnSJcCA0d4g==',key_name='tempest-keypair-619756720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb14118064e6484894e9b4a79ab37c84',ramdisk_id='',reservation_id='r-7jcews07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-260506164',owner_user_name='tempest-ServerActionsV293TestJSON-260506164-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9491905f6ed54a8cbe025f465f663b30',uuid=408f6bb4-f944-4043-8e61-a62ac7d49938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converting VIF {"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28011a4c-3b, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f210af6-82c1-4200-90b9-b2a6d349f453) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: INFO os_vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b')
Oct 17 11:52:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:52:15 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cfb0c1-4b81-44a1-acef-de4f72b02128]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:52:15 user nova-compute[74261]: No targets found.
Oct 17 11:52:15 user nova-compute[74261]: iSNS:
Oct 17 11:52:15 user nova-compute[74261]: No targets found.
Oct 17 11:52:15 user nova-compute[74261]: STATIC:
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:52:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:15 user nova-compute[74261]: FIRMWARE:
Oct 17 11:52:15 user nova-compute[74261]: No targets found.
Oct 17 11:52:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:52:15 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:52:15 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feea122-d373-4db2-bcbd-03e961a3a4a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd1aec2-9a60-4cf8-95dc-b5587e7dd52a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:52:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b241153f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5'): ({'sdf'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Removing single pathed devices sdf {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6212c1de-c6ef-45fb-99d0-19aa25dc3232]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2523d-5a87-4dec-9241-90215ef80ba2]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Flushing IO for device /dev/sdf {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1934af15-18c3-4ea1-8d6a-a22d25d321df]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d265977b-1497-4045-8cec-b81a7503c72a]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f0cac-12c7-4ce5-b843-a657ca3c3b95]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:52:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.108s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30c78e-f833-4403-a49d-2931201c7243]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]
Oct 17 11:52:16 user nova-compute[74261]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.
Oct 17 11:52:16 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5883d-acb9-4117-b5a8-7be2feba4bea]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== disconnect_volume: return (441ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:52:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Deleting instance files /opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938_del
Oct 17 11:52:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Deletion of /opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938_del complete
Oct 17 11:52:16 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 could not be found.
Oct 17 11:52:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:52:16 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710c47d-97e2-49c4-8db2-c4875b6ecf8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:52:16 user nova-compute[74261]: No targets found.
Oct 17 11:52:16 user nova-compute[74261]: iSNS:
Oct 17 11:52:16 user nova-compute[74261]: No targets found.
Oct 17 11:52:16 user nova-compute[74261]: STATIC:
Oct 17 11:52:16 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:52:16 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:16 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:16 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:52:16 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:16 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:16 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074
Oct 17 11:52:16 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:16 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:16 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:52:16 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:16 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:16 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:52:16 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:16 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:16 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:52:16 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:52:16 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:52:16 user nova-compute[74261]: FIRMWARE:
Oct 17 11:52:16 user nova-compute[74261]: No targets found.
Oct 17 11:52:16 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:52:17 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:52:17 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[15736590-1619-46ba-9236-f8a2197f0177]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdbdb29-04fd-4d90-9c62-272f2bf67cfd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:52:17 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2f7e20>, {}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Disconnecting from: [] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== disconnect_volume: return (84ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-96b6a8dd-9b48-4c3d-8821-8954ae9f4bf9 req-98f7404a-4f82-475e-82de-27fbbc5645e8 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-96b6a8dd-9b48-4c3d-8821-8954ae9f4bf9 req-98f7404a-4f82-475e-82de-27fbbc5645e8 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-96b6a8dd-9b48-4c3d-8821-8954ae9f4bf9 req-98f7404a-4f82-475e-82de-27fbbc5645e8 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-96b6a8dd-9b48-4c3d-8821-8954ae9f4bf9 req-98f7404a-4f82-475e-82de-27fbbc5645e8 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-96b6a8dd-9b48-4c3d-8821-8954ae9f4bf9 req-98f7404a-4f82-475e-82de-27fbbc5645e8 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:17 user nova-compute[74261]: WARNING nova.compute.manager [req-96b6a8dd-9b48-4c3d-8821-8954ae9f4bf9 req-98f7404a-4f82-475e-82de-27fbbc5645e8 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state rebuilding.
Oct 17 11:52:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Preparing to wait for external event volume-reimaged-90be0a73-9516-46e6-b82a-f9e4d588d2a5 {{(pid=74261) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:52:26 user nova-compute[74261]: INFO nova.compute.manager [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] instance snapshotting
Oct 17 11:52:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Beginning live snapshot process
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-changed-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Refreshing instance network info cache due to event network-changed-78b07125-b7dd-4f7f-bfdd-7f4d044cd258. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] Acquiring lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] Acquired lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG nova.network.neutron [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Refreshing network info cache for port 78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpegmzqtfx/7c01d7df23754335a275ebce185b3248.delta 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpegmzqtfx/7c01d7df23754335a275ebce185b3248.delta 1073741824" returned: 0 in 0.080s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:27 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "47c78622-6d42-43a6-93bb-298210ae07dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:28 user nova-compute[74261]: INFO nova.compute.manager [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Terminating instance
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.network.neutron [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Updated VIF entry in instance network info cache for port 78b07125-b7dd-4f7f-bfdd-7f4d044cd258. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.network.neutron [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Updating instance_info_cache with network_info: [{"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-11f843a9-214f-4ffc-a18a-a4dbbe666e63 req-47e16e0e-4ed9-4b96-bda4-d3aad10bf8de service nova] Releasing lock "refresh_cache-47c78622-6d42-43a6-93bb-298210ae07dc" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-fa8d9eb1-fa48-442f-86a9-0af129d271b6 req-d320a23b-631a-4a1f-9eee-24ed24897adc service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-unplugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fa8d9eb1-fa48-442f-86a9-0af129d271b6 req-d320a23b-631a-4a1f-9eee-24ed24897adc service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fa8d9eb1-fa48-442f-86a9-0af129d271b6 req-d320a23b-631a-4a1f-9eee-24ed24897adc service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fa8d9eb1-fa48-442f-86a9-0af129d271b6 req-d320a23b-631a-4a1f-9eee-24ed24897adc service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-fa8d9eb1-fa48-442f-86a9-0af129d271b6 req-d320a23b-631a-4a1f-9eee-24ed24897adc service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-unplugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-fa8d9eb1-fa48-442f-86a9-0af129d271b6 req-d320a23b-631a-4a1f-9eee-24ed24897adc service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-unplugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:52:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Instance destroyed successfully.
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.objects.instance [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'resources' on Instance uuid 47c78622-6d42-43a6-93bb-298210ae07dc {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-158560098',display_name='tempest-AttachVolumeNegativeTest-server-158560098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-158560098',id=21,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjsO/M12kCbMLMwkgON1+9xusUw/2Cf2p5GYIiLuVRI4ZFrmcg2UVxrz5x+HGeORfaIwDmPpC0ZbyVUYyhK2zwqYEhWX1CE/Dd3TKfOL0OHMBW9YZLC6Mn+mV52CGXHaw==',key_name='tempest-keypair-1198983276',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-6k4oaw9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=47c78622-6d42-43a6-93bb-298210ae07dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "address": "fa:16:3e:f3:0a:0f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07125-b7", "ovs_interfaceid": "78b07125-b7dd-4f7f-bfdd-7f4d044cd258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG os_vif [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78b07125-b7, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91a544fb-b00d-4446-9ef4-31e7ad81443a) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: INFO os_vif [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=78b07125-b7dd-4f7f-bfdd-7f4d044cd258,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07125-b7')
Oct 17 11:52:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Deleting instance files /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc_del
Oct 17 11:52:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Deletion of /opt/stack/data/nova/instances/47c78622-6d42-43a6-93bb-298210ae07dc_del complete
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 11:52:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 11:52:29 user nova-compute[74261]: INFO nova.compute.manager [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 17 11:52:29 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpegmzqtfx/7c01d7df23754335a275ebce185b3248.delta /opt/stack/data/nova/instances/snapshots/tmpegmzqtfx/7c01d7df23754335a275ebce185b3248 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpegmzqtfx/7c01d7df23754335a275ebce185b3248.delta /opt/stack/data/nova/instances/snapshots/tmpegmzqtfx/7c01d7df23754335a275ebce185b3248" returned: 0 in 0.830s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Snapshot extracted, beginning image upload
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:30 user nova-compute[74261]: WARNING nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received unexpected event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with vm_state active and task_state deleting.
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:30 user nova-compute[74261]: WARNING nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received unexpected event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with vm_state active and task_state deleting.
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:30 user nova-compute[74261]: WARNING nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received unexpected event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with vm_state active and task_state deleting.
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-unplugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-unplugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-unplugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Acquiring lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] Lock "47c78622-6d42-43a6-93bb-298210ae07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] No waiting events found dispatching network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:30 user nova-compute[74261]: WARNING nova.compute.manager [req-15369b57-79b5-4e20-9b60-cd68c39154b1 req-0a07d53b-1a11-4fca-8d21-8d93a4a2323e service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received unexpected event network-vif-plugged-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 for instance with vm_state active and task_state deleting.
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:30 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Took 1.57 seconds to deallocate network for instance.
Oct 17 11:52:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-1bd88447-4c23-4fe0-8740-07245f044515 req-96076fa0-47b4-4fef-b985-569cc4a70784 service nova] [instance: 47c78622-6d42-43a6-93bb-298210ae07dc] Received event network-vif-deleted-78b07125-b7dd-4f7f-bfdd-7f4d044cd258 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:52:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:52:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:31 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Deleted allocations for instance 47c78622-6d42-43a6-93bb-298210ae07dc
Oct 17 11:52:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-588447d4-5698-49fd-8ad0-e0da88c5acf8 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "47c78622-6d42-43a6-93bb-298210ae07dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.571s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:32 user nova-compute[74261]: INFO nova.compute.manager [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Terminating instance
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-496400b1-61f5-4aff-852b-886756c9be09 req-07f3f34d-ad15-41e2-8f9f-6ad83a3a3432 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-vif-unplugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-496400b1-61f5-4aff-852b-886756c9be09 req-07f3f34d-ad15-41e2-8f9f-6ad83a3a3432 service nova] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-496400b1-61f5-4aff-852b-886756c9be09 req-07f3f34d-ad15-41e2-8f9f-6ad83a3a3432 service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-496400b1-61f5-4aff-852b-886756c9be09 req-07f3f34d-ad15-41e2-8f9f-6ad83a3a3432 service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-496400b1-61f5-4aff-852b-886756c9be09 req-07f3f34d-ad15-41e2-8f9f-6ad83a3a3432 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] No waiting events found dispatching network-vif-unplugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-496400b1-61f5-4aff-852b-886756c9be09 req-07f3f34d-ad15-41e2-8f9f-6ad83a3a3432 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-vif-unplugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:52:32 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Instance destroyed successfully.
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lazy-loading 'resources' on Instance uuid 6873f406-8c93-4d9d-b0d5-92296614b94b {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1775373920',display_name='tempest-ServerActionsTestOtherB-server-1775373920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1775373920',id=6,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD43oez7iXtXpmEHy0pGJh6/aiWEr34F1mNahsepZ9wK/OIeyWZlnYMBk+RnpUdGd94QnXxPAR2Z8mdLi6S188TTfXPgMIN4XRoGzeRBfLWIMJ0kEG/8DuepEadTxBl8yg==',key_name='tempest-keypair-880199744',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d228de3ac0d4302ae6c0faeccd193da',ramdisk_id='',reservation_id='r-78h3s10u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-99003794',owner_user_name='tempest-ServerActionsTestOtherB-99003794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3715fef81bd7489b99988481ad3370db',uuid=6873f406-8c93-4d9d-b0d5-92296614b94b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Converting VIF {"id": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "address": "fa:16:3e:82:71:fe", "network": {"id": "58fc8627-cf03-457c-97fb-5a31f1dd189f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-598011909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d228de3ac0d4302ae6c0faeccd193da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb17ef68-79", "ovs_interfaceid": "eb17ef68-792f-4ebb-aff8-d18cb41cb992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:32 user nova-compute[74261]: DEBUG os_vif [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb17ef68-79, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=942913e5-f6f5-45f4-9154-86e29e7ed538) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:33 user nova-compute[74261]: INFO os_vif [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=eb17ef68-792f-4ebb-aff8-d18cb41cb992,network=Network(58fc8627-cf03-457c-97fb-5a31f1dd189f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb17ef68-79')
Oct 17 11:52:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Deleting instance files /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b_del
Oct 17 11:52:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Deletion of /opt/stack/data/nova/instances/6873f406-8c93-4d9d-b0d5-92296614b94b_del complete
Oct 17 11:52:33 user nova-compute[74261]: INFO nova.compute.manager [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 17 11:52:33 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:52:33 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:52:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Snapshot image upload complete
Oct 17 11:52:33 user nova-compute[74261]: INFO nova.compute.manager [None req-4f687b33-4405-4893-891e-c1fb17e6b4e0 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Took 6.60 seconds to snapshot the instance on the hypervisor.
Oct 17 11:52:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:34 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Took 1.08 seconds to deallocate network for instance.
Oct 17 11:52:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-3c56bd8f-c8a5-42b9-b676-531a4afb51f1 req-17d6f333-d8ba-44bb-a4ef-196ec1f8a206 service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-vif-deleted-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-d52fe906-309d-4199-b202-c47cae654138 req-946ca0f8-73ad-4fdf-8cda-b5f070378adf service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received event network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d52fe906-309d-4199-b202-c47cae654138 req-946ca0f8-73ad-4fdf-8cda-b5f070378adf service nova] Acquiring lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d52fe906-309d-4199-b202-c47cae654138 req-946ca0f8-73ad-4fdf-8cda-b5f070378adf service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d52fe906-309d-4199-b202-c47cae654138 req-946ca0f8-73ad-4fdf-8cda-b5f070378adf service nova] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-d52fe906-309d-4199-b202-c47cae654138 req-946ca0f8-73ad-4fdf-8cda-b5f070378adf service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] No waiting events found dispatching network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:34 user nova-compute[74261]: WARNING nova.compute.manager [req-d52fe906-309d-4199-b202-c47cae654138 req-946ca0f8-73ad-4fdf-8cda-b5f070378adf service nova] [instance: 6873f406-8c93-4d9d-b0d5-92296614b94b] Received unexpected event network-vif-plugged-eb17ef68-792f-4ebb-aff8-d18cb41cb992 for instance with vm_state deleted and task_state None.
Oct 17 11:52:34 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:34 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Deleted allocations for instance 6873f406-8c93-4d9d-b0d5-92296614b94b
Oct 17 11:52:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f28a782b-7330-4efc-9359-cc2ee9872bdd tempest-ServerActionsTestOtherB-99003794 tempest-ServerActionsTestOtherB-99003794-project-member] Lock "6873f406-8c93-4d9d-b0d5-92296614b94b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Acquiring lock "7130e449-0369-4b63-8c21-7f9239b44254" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Lock "7130e449-0369-4b63-8c21-7f9239b44254" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:52:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:44 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:52:44 user nova-compute[74261]: INFO nova.compute.claims [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Claim successful on node user
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:52:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:52:45 user nova-compute[74261]: INFO nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Booting with volume b1225cb2-191d-4748-9faf-e15a45e6a820 at /dev/vda
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.policy [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb053d82ce98480599e4656ed6450466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a8769cd3704a8bbd693daad61bec44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG os_brick.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f9dd69-e3b2-4d72-a1ee-b6af4cf5f9f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2f12e0-80a4-4f47-b5c7-08d7c95bb31f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb4fa8-66fe-424a-8026-f4dacdf509b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8d687-2655-438c-b4be-3c1d0927d7fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:52:45 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:52:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a139a1-6416-4059-95f3-2ea91463b46a]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG os_brick.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating existing volume attachment record: 668647ff-9041-45cd-8403-1ce91e2316f2 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully created port: 61eabd60-64db-456f-aa99-11fee2a0e88e {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d req-a55c823e-e783-4cd3-b2af-82b744578d7f service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event volume-reimaged-90be0a73-9516-46e6-b82a-f9e4d588d2a5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d req-a55c823e-e783-4cd3-b2af-82b744578d7f service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d req-a55c823e-e783-4cd3-b2af-82b744578d7f service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d req-a55c823e-e783-4cd3-b2af-82b744578d7f service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d req-a55c823e-e783-4cd3-b2af-82b744578d7f service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Processing event volume-reimaged-90be0a73-9516-46e6-b82a-f9e4d588d2a5 {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance event wait completed in 28 seconds for volume-reimaged {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:52:46 user nova-compute[74261]: INFO nova.virt.block_device [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Booting with volume 90be0a73-9516-46e6-b82a-f9e4d588d2a5 at /dev/vda
Oct 17 11:52:46 user nova-compute[74261]: DEBUG os_brick.utils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3ceede-2cdc-4744-8b7b-d23edd1128bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c962264-9492-44dd-b935-d5f2f55b6e9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a0f4b-988d-4d28-b5ed-e9d84d004e22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0578c4-8af6-48c8-8b80-f07acbf808f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:52:46 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:52:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32b3a77-e7e5-4177-91ca-f714c71f5094]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG os_brick.utils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating existing volume attachment record: 934fecb0-3844-4b8d-a14b-4ce48587b8cf {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:52:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully created port: ae5f39c7-acdb-4c45-aacb-2d419e596afc {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:52:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully created port: 38547cef-bb1f-4f67-ac9e-3bbe63a92b3d {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:52:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully created port: 4ad34283-a705-4454-be75-75eff88afab5 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:52:48 user nova-compute[74261]: INFO nova.compute.claims [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Claim successful on node user
Oct 17 11:52:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully created port: 88359059-5e3f-47cd-a535-f3897a7ef19e {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:52:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.policy [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '229ff57765914e75a370db408f67c501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117fbb67e9764c1e9e3211ba9a08b864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: 61eabd60-64db-456f-aa99-11fee2a0e88e {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:52:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Creating image(s)
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-61eabd60-64db-456f-aa99-11fee2a0e88e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-61eabd60-64db-456f-aa99-11fee2a0e88e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port 61eabd60-64db-456f-aa99-11fee2a0e88e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.239s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk 1073741824" returned: 0 in 0.070s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Successfully created port: 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:52:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac28223e-0558-4a6e-ad31-f3c6b648186c req-5f54da6c-2a53-40c0-99ac-0d158936009c service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: d8c050ab-7691-4acb-aaed-7b8abe47c576 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Cannot resize image /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Ensure instance console log exists: /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Successfully updated port: 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing instance network info cache due to event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: 01fd110a-c709-4e4b-abda-4b420a8f4384 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance network_info: |[{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Start _get_guest_xml network_info=[{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:52:51 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:52:51 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-51782779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-51782779',id=24,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrC/4RdHpsq2imB2jjET73dzW7Rr/DjghQOLDW/UXYyzTHfBfO+vwF8aWnMIpWcG/xgtbOFiamQbdpez9ykrHCxt9dVWgH7Pxt76oQ92kuIN21rgT0nv0bmhxcTaFNyw==',key_name='tempest-keypair-1685563374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-vlytl2r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=527e094a-0c2f-4867-bc71-29b05f4812da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'pci_devices' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:52:51 user nova-compute[74261]:   <uuid>527e094a-0c2f-4867-bc71-29b05f4812da</uuid>
Oct 17 11:52:51 user nova-compute[74261]:   <name>instance-00000018</name>
Oct 17 11:52:51 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:52:51 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:52:51 user nova-compute[74261]:   <metadata>
Oct 17 11:52:51 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:52:51 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:52:51 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-51782779</nova:name>
Oct 17 11:52:51 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:52:51</nova:creationTime>
Oct 17 11:52:51 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:52:51 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:52:51 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:52:51 user nova-compute[74261]:       <nova:owner>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:user uuid="229ff57765914e75a370db408f67c501">tempest-AttachVolumeShelveTestJSON-63868510-project-member</nova:user>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:project uuid="117fbb67e9764c1e9e3211ba9a08b864">tempest-AttachVolumeShelveTestJSON-63868510</nova:project>
Oct 17 11:52:51 user nova-compute[74261]:       </nova:owner>
Oct 17 11:52:51 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:52:51 user nova-compute[74261]:       <nova:ports>
Oct 17 11:52:51 user nova-compute[74261]:         <nova:port uuid="9ef1b19a-36ae-4c27-af51-de9dcf45f4ad">
Oct 17 11:52:51 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 11:52:51 user nova-compute[74261]:         </nova:port>
Oct 17 11:52:51 user nova-compute[74261]:       </nova:ports>
Oct 17 11:52:51 user nova-compute[74261]:     </nova:instance>
Oct 17 11:52:51 user nova-compute[74261]:   </metadata>
Oct 17 11:52:51 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:52:51 user nova-compute[74261]:     <system>
Oct 17 11:52:51 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:52:51 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:52:51 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:52:51 user nova-compute[74261]:       <entry name="serial">527e094a-0c2f-4867-bc71-29b05f4812da</entry>
Oct 17 11:52:51 user nova-compute[74261]:       <entry name="uuid">527e094a-0c2f-4867-bc71-29b05f4812da</entry>
Oct 17 11:52:51 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:52:51 user nova-compute[74261]:     </system>
Oct 17 11:52:51 user nova-compute[74261]:   </sysinfo>
Oct 17 11:52:51 user nova-compute[74261]:   <os>
Oct 17 11:52:51 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:52:51 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:52:51 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:52:51 user nova-compute[74261]:   </os>
Oct 17 11:52:51 user nova-compute[74261]:   <features>
Oct 17 11:52:51 user nova-compute[74261]:     <acpi/>
Oct 17 11:52:51 user nova-compute[74261]:     <apic/>
Oct 17 11:52:51 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:52:51 user nova-compute[74261]:   </features>
Oct 17 11:52:51 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:52:51 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:52:51 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:52:51 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:52:51 user nova-compute[74261]:   </clock>
Oct 17 11:52:51 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:52:51 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:52:51 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:52:51 user nova-compute[74261]:   </cpu>
Oct 17 11:52:51 user nova-compute[74261]:   <devices>
Oct 17 11:52:51 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:52:51 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:52:51 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk"/>
Oct 17 11:52:51 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:52:51 user nova-compute[74261]:     </disk>
Oct 17 11:52:51 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:52:51 user nova-compute[74261]:       <mac address="fa:16:3e:b9:91:f6"/>
Oct 17 11:52:51 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:52:51 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:52:51 user nova-compute[74261]:       <target dev="tap9ef1b19a-36"/>
Oct 17 11:52:51 user nova-compute[74261]:     </interface>
Oct 17 11:52:51 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:52:51 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/console.log" append="off"/>
Oct 17 11:52:51 user nova-compute[74261]:     </serial>
Oct 17 11:52:51 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:52:51 user nova-compute[74261]:     <video>
Oct 17 11:52:51 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:52:51 user nova-compute[74261]:     </video>
Oct 17 11:52:51 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:52:51 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:52:51 user nova-compute[74261]:     </rng>
Oct 17 11:52:51 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:52:51 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:52:51 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:52:51 user nova-compute[74261]:     </memballoon>
Oct 17 11:52:51 user nova-compute[74261]:   </devices>
Oct 17 11:52:51 user nova-compute[74261]: </domain>
Oct 17 11:52:51 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-51782779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-51782779',id=24,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrC/4RdHpsq2imB2jjET73dzW7Rr/DjghQOLDW/UXYyzTHfBfO+vwF8aWnMIpWcG/xgtbOFiamQbdpez9ykrHCxt9dVWgH7Pxt76oQ92kuIN21rgT0nv0bmhxcTaFNyw==',key_name='tempest-keypair-1685563374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-vlytl2r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=527e094a-0c2f-4867-bc71-29b05f4812da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG os_vif [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9aa11dd-a6ef-555b-860d-e601c038646d', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ef1b19a-36, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ef1b19a-36, col_values=(('qos', UUID('2901ab57-814f-4f29-a27e-c20323468215')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ef1b19a-36, col_values=(('external_ids', {'iface-id': '9ef1b19a-36ae-4c27-af51-de9dcf45f4ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:91:f6', 'vm-uuid': '527e094a-0c2f-4867-bc71-29b05f4812da'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: ae5f39c7-acdb-4c45-aacb-2d419e596afc {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:51 user nova-compute[74261]: INFO os_vif [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36')
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-d8c050ab-7691-4acb-aaed-7b8abe47c576 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-d8c050ab-7691-4acb-aaed-7b8abe47c576. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port d8c050ab-7691-4acb-aaed-7b8abe47c576 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No VIF found with MAC fa:16:3e:b9:91:f6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-01fd110a-c709-4e4b-abda-4b420a8f4384 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-01fd110a-c709-4e4b-abda-4b420a8f4384. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port 01fd110a-c709-4e4b-abda-4b420a8f4384 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updated VIF entry in instance network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b86d2dec-e138-4d1d-b08b-8bcee789a92e req-d256a8db-f112-4ba4-b263-5b23ca4931ed service nova] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:51 user nova-compute[74261]: DEBUG nova.network.neutron [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:52:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: 38547cef-bb1f-4f67-ac9e-3bbe63a92b3d {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:52 user nova-compute[74261]: DEBUG nova.network.neutron [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7874e9d7-8af4-4f7f-ac2c-303ccc9aa6a6 req-ad7b390d-acdf-4e0a-8916-88085e12d042 service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: 4ad34283-a705-4454-be75-75eff88afab5 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'info_cache' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Successfully updated port: 88359059-5e3f-47cd-a535-f3897a7ef19e {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-b408f61d-24e5-436a-997e-196509531466 req-d47f44fd-04d1-4aba-8d75-65882acd8a5d service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b408f61d-24e5-436a-997e-196509531466 req-d47f44fd-04d1-4aba-8d75-65882acd8a5d service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b408f61d-24e5-436a-997e-196509531466 req-d47f44fd-04d1-4aba-8d75-65882acd8a5d service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b408f61d-24e5-436a-997e-196509531466 req-d47f44fd-04d1-4aba-8d75-65882acd8a5d service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-b408f61d-24e5-436a-997e-196509531466 req-d47f44fd-04d1-4aba-8d75-65882acd8a5d service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:53 user nova-compute[74261]: WARNING nova.compute.manager [req-b408f61d-24e5-436a-997e-196509531466 req-d47f44fd-04d1-4aba-8d75-65882acd8a5d service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state building and task_state spawning.
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-ae5f39c7-acdb-4c45-aacb-2d419e596afc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-ae5f39c7-acdb-4c45-aacb-2d419e596afc. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance destroyed successfully.
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'resources' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG os_vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf15dff2-7d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb898c14-53af-40d4-8946-a407625f1e1d) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:53 user nova-compute[74261]: INFO os_vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d')
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start _get_guest_xml network_info=[{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'numa_topology' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:53 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:52:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'pci_devices' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:52:54 user nova-compute[74261]:   <uuid>93fe26e6-4a68-4976-b53c-3c33250c20de</uuid>
Oct 17 11:52:54 user nova-compute[74261]:   <name>instance-00000005</name>
Oct 17 11:52:54 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:52:54 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:52:54 user nova-compute[74261]:   <metadata>
Oct 17 11:52:54 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:52:54 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:52:54 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeTestJSON-server-1703914465</nova:name>
Oct 17 11:52:54 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:52:54</nova:creationTime>
Oct 17 11:52:54 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:52:54 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:52:54 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:52:54 user nova-compute[74261]:       <nova:owner>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:user uuid="0f0a17cbf46d422899c2dad6b8000fb3">tempest-AttachVolumeTestJSON-1691828841-project-member</nova:user>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:project uuid="743ac99ae6b44e43ab599e1731d79b3b">tempest-AttachVolumeTestJSON-1691828841</nova:project>
Oct 17 11:52:54 user nova-compute[74261]:       </nova:owner>
Oct 17 11:52:54 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:52:54 user nova-compute[74261]:       <nova:ports>
Oct 17 11:52:54 user nova-compute[74261]:         <nova:port uuid="af15dff2-7dd0-449e-9cfa-9ae2135a43d4">
Oct 17 11:52:54 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 11:52:54 user nova-compute[74261]:         </nova:port>
Oct 17 11:52:54 user nova-compute[74261]:       </nova:ports>
Oct 17 11:52:54 user nova-compute[74261]:     </nova:instance>
Oct 17 11:52:54 user nova-compute[74261]:   </metadata>
Oct 17 11:52:54 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:52:54 user nova-compute[74261]:     <system>
Oct 17 11:52:54 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:52:54 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:52:54 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:52:54 user nova-compute[74261]:       <entry name="serial">93fe26e6-4a68-4976-b53c-3c33250c20de</entry>
Oct 17 11:52:54 user nova-compute[74261]:       <entry name="uuid">93fe26e6-4a68-4976-b53c-3c33250c20de</entry>
Oct 17 11:52:54 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:52:54 user nova-compute[74261]:     </system>
Oct 17 11:52:54 user nova-compute[74261]:   </sysinfo>
Oct 17 11:52:54 user nova-compute[74261]:   <os>
Oct 17 11:52:54 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:52:54 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:52:54 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:52:54 user nova-compute[74261]:   </os>
Oct 17 11:52:54 user nova-compute[74261]:   <features>
Oct 17 11:52:54 user nova-compute[74261]:     <acpi/>
Oct 17 11:52:54 user nova-compute[74261]:     <apic/>
Oct 17 11:52:54 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:52:54 user nova-compute[74261]:   </features>
Oct 17 11:52:54 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:52:54 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:52:54 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:52:54 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:52:54 user nova-compute[74261]:   </clock>
Oct 17 11:52:54 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:52:54 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:52:54 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:52:54 user nova-compute[74261]:   </cpu>
Oct 17 11:52:54 user nova-compute[74261]:   <devices>
Oct 17 11:52:54 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:52:54 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:52:54 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk"/>
Oct 17 11:52:54 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:52:54 user nova-compute[74261]:     </disk>
Oct 17 11:52:54 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:52:54 user nova-compute[74261]:       <mac address="fa:16:3e:83:f7:64"/>
Oct 17 11:52:54 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:52:54 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:52:54 user nova-compute[74261]:       <target dev="tapaf15dff2-7d"/>
Oct 17 11:52:54 user nova-compute[74261]:     </interface>
Oct 17 11:52:54 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:52:54 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/console.log" append="off"/>
Oct 17 11:52:54 user nova-compute[74261]:     </serial>
Oct 17 11:52:54 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:52:54 user nova-compute[74261]:     <video>
Oct 17 11:52:54 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:52:54 user nova-compute[74261]:     </video>
Oct 17 11:52:54 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:52:54 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:52:54 user nova-compute[74261]:     </rng>
Oct 17 11:52:54 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:52:54 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:52:54 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:52:54 user nova-compute[74261]:     </memballoon>
Oct 17 11:52:54 user nova-compute[74261]:   </devices>
Oct 17 11:52:54 user nova-compute[74261]: </domain>
Oct 17 11:52:54 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Cannot resize image /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'migration_context' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Object Instance<93fe26e6-4a68-4976-b53c-3c33250c20de> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG os_vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '645fa193-3a41-5ffd-8cc3-6602159c63d6', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf15dff2-7d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf15dff2-7d, col_values=(('qos', UUID('8637fbb7-f0ff-47af-8d98-3cad082a3f1d')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf15dff2-7d, col_values=(('external_ids', {'iface-id': 'af15dff2-7dd0-449e-9cfa-9ae2135a43d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:f7:64', 'vm-uuid': '93fe26e6-4a68-4976-b53c-3c33250c20de'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:52:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:54 user nova-compute[74261]: INFO os_vif [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d')
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [{"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Instance network_info: |[{"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port ae5f39c7-acdb-4c45-aacb-2d419e596afc {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:55 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance spawned successfully.
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:52:55 user nova-compute[74261]: INFO nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Took 6.19 seconds to spawn the instance on the hypervisor.
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-206c6d98-9184-48e7-86f6-af1cf4009387 req-2a86e190-7b3b-41de-a259-4c8fda7c9f56 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-206c6d98-9184-48e7-86f6-af1cf4009387 req-2a86e190-7b3b-41de-a259-4c8fda7c9f56 service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-206c6d98-9184-48e7-86f6-af1cf4009387 req-2a86e190-7b3b-41de-a259-4c8fda7c9f56 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-206c6d98-9184-48e7-86f6-af1cf4009387 req-2a86e190-7b3b-41de-a259-4c8fda7c9f56 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-206c6d98-9184-48e7-86f6-af1cf4009387 req-2a86e190-7b3b-41de-a259-4c8fda7c9f56 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:55 user nova-compute[74261]: WARNING nova.compute.manager [req-206c6d98-9184-48e7-86f6-af1cf4009387 req-2a86e190-7b3b-41de-a259-4c8fda7c9f56 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state building and task_state spawning.
Oct 17 11:52:55 user nova-compute[74261]: INFO nova.compute.manager [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Took 7.05 seconds to build instance.
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0c8b9c05-78c1-4532-b67e-076b15502e08 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.165s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updated VIF entry in instance network info cache for port ae5f39c7-acdb-4c45-aacb-2d419e596afc. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [{"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-38547cef-bb1f-4f67-ac9e-3bbe63a92b3d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-38547cef-bb1f-4f67-ac9e-3bbe63a92b3d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port 38547cef-bb1f-4f67-ac9e-3bbe63a92b3d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-66acad5d-2483-4066-8bec-469bfc065cca req-ecfbc475-59ce-4be3-809b-390efd8bf780 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66acad5d-2483-4066-8bec-469bfc065cca req-ecfbc475-59ce-4be3-809b-390efd8bf780 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66acad5d-2483-4066-8bec-469bfc065cca req-ecfbc475-59ce-4be3-809b-390efd8bf780 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66acad5d-2483-4066-8bec-469bfc065cca req-ecfbc475-59ce-4be3-809b-390efd8bf780 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-66acad5d-2483-4066-8bec-469bfc065cca req-ecfbc475-59ce-4be3-809b-390efd8bf780 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:56 user nova-compute[74261]: WARNING nova.compute.manager [req-66acad5d-2483-4066-8bec-469bfc065cca req-ecfbc475-59ce-4be3-809b-390efd8bf780 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state stopped and task_state powering-on.
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updated VIF entry in instance network info cache for port 38547cef-bb1f-4f67-ac9e-3bbe63a92b3d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [{"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-4ad34283-a705-4454-be75-75eff88afab5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-4ad34283-a705-4454-be75-75eff88afab5. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port 4ad34283-a705-4454-be75-75eff88afab5 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updated VIF entry in instance network info cache for port 4ad34283-a705-4454-be75-75eff88afab5. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [{"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Received event network-changed-88359059-5e3f-47cd-a535-f3897a7ef19e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing instance network info cache due to event network-changed-88359059-5e3f-47cd-a535-f3897a7ef19e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquiring lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Acquired lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Refreshing network info cache for port 88359059-5e3f-47cd-a535-f3897a7ef19e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updated VIF entry in instance network info cache for port 88359059-5e3f-47cd-a535-f3897a7ef19e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [{"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0b62179-7cd9-48cf-8ac3-fd1c8d078fa5 req-8b108804-9153-4944-abd2-8a5e22aad2bc service nova] Releasing lock "refresh_cache-7130e449-0369-4b63-8c21-7f9239b44254" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:57 user nova-compute[74261]: INFO nova.compute.manager [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Detaching volume b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:52:57 user nova-compute[74261]: INFO nova.virt.block_device [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Attempting to driver detach volume b91af6ad-b594-4775-aa9e-cd8c6ad41987 from mountpoint /dev/vdb
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Attempting to detach device vdb from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:52:58 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:52:58 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:52:58 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:52:58 user nova-compute[74261]:   <serial>b91af6ad-b594-4775-aa9e-cd8c6ad41987</serial>
Oct 17 11:52:58 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:52:58 user nova-compute[74261]: </disk>
Oct 17 11:52:58 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:52:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully detached device vdb from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 from the persistent domain config.
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:52:58 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:52:58 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:52:58 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:52:58 user nova-compute[74261]:   <serial>b91af6ad-b594-4775-aa9e-cd8c6ad41987</serial>
Oct 17 11:52:58 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:52:58 user nova-compute[74261]: </disk>
Oct 17 11:52:58 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-5f0b6b19-9738-4dc0-9a55-70560efeba67 req-bc5394d9-0b44-456f-9c30-ef11c256fef3 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5f0b6b19-9738-4dc0-9a55-70560efeba67 req-bc5394d9-0b44-456f-9c30-ef11c256fef3 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5f0b6b19-9738-4dc0-9a55-70560efeba67 req-bc5394d9-0b44-456f-9c30-ef11c256fef3 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5f0b6b19-9738-4dc0-9a55-70560efeba67 req-bc5394d9-0b44-456f-9c30-ef11c256fef3 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-5f0b6b19-9738-4dc0-9a55-70560efeba67 req-bc5394d9-0b44-456f-9c30-ef11c256fef3 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:52:58 user nova-compute[74261]: WARNING nova.compute.manager [req-5f0b6b19-9738-4dc0-9a55-70560efeba67 req-bc5394d9-0b44-456f-9c30-ef11c256fef3 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state stopped and task_state powering-on.
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:52:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance rebooted successfully.
Oct 17 11:52:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-646985a1-dd3e-46a3-989c-d41f623ec432 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:52:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:52:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:53:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: INFO nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Booting with volume 7db05946-3094-40bd-9a89-0a82aa7b8f6b at /dev/vdb
Oct 17 11:53:06 user nova-compute[74261]: DEBUG os_brick.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5dd6ab-b5f9-4b39-8ad1-7878883f5c55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[523ab2cf-1368-42db-8092-80ebeaf8d706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e54c3-8e99-4553-84e6-8eedaca9b371]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42a024a-6536-4a18-8192-548a78e2f033]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:53:06 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40e2f8e-1bc8-4162-a928-d036c6850a9e]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG os_brick.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating existing volume attachment record: 51860dc2-1383-48c8-8cd4-40f8f93fd7e9 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:53:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Creating image(s)
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Ensure instance console log exists: /opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Start _get_guest_xml network_info=[{"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '934fecb0-3844-4b8d-a14b-4ce48587b8cf', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '408f6bb4-f944-4043-8e61-a62ac7d49938', 'attached_at': '', 'detached_at': '', 'volume_id': '90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'serial': '90be0a73-9516-46e6-b82a-f9e4d588d2a5'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:53:07 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 11:53:07 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lazy-loading 'vcpu_model' on Instance uuid 408f6bb4-f944-4043-8e61-a62ac7d49938 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:07 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:07 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:07 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c878c1b0-cb89-4c18-8ff5-8255fcf7816e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:53:07 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71409c-61a5-4482-934c-5cb6a2021745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5] added
Oct 17 11:53:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[23813ea2-cfc1-430f-919b-fbdfb21032d7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c8f44c-81c5-4f49-8af6-0bf78c7b2500]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPBqHein {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPBqHein" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[113dbfb3-b7f5-4e23-b27b-aecf4c07a405]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hPBqHein'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[726b74aa-68ac-4d8e-8926-fda9f36c84ac]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ae4248-0f28-4217-af26-ff7ee8dd7bde]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3203f05-a17f-4b6e-828f-270de5931fdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]
Oct 17 11:53:07 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.
Oct 17 11:53:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d390a-d872-4ea1-b57b-389dbb857c2d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b7bffe-f1c9-4496-a3fc-59271a86b5e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:07 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.595s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ab12d9-71d5-4365-88e3-28e7ae2ccbad]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.642s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== connect_volume: return (1644ms) {'type': 'block', 'scsi_wwn': '23834633866663433', 'path': '/dev/sdf'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834633866663433', 'path': '/dev/sdf'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424524728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-669144641',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe0H6TYJKtnM5UZxmp/5bHuEIzV0OVEDrIFCPQDY/SO41uj9ABVdiu5V1E6uGlhC8TuUzI7/t4NohLrqHWMbM7ORBEcE9rrb6hRtwcufBsxZzn5h8m8f0JBnSJcCA0d4g==',key_name='tempest-keypair-619756720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb14118064e6484894e9b4a79ab37c84',ramdisk_id='',reservation_id='r-7jcews07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-260506164',owner_user_name='tempest-ServerActionsV293TestJSON-260506164-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9491905f6ed54a8cbe025f465f663b30',uuid=408f6bb4-f944-4043-8e61-a62ac7d49938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converting VIF {"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:53:08 user nova-compute[74261]:   <uuid>408f6bb4-f944-4043-8e61-a62ac7d49938</uuid>
Oct 17 11:53:08 user nova-compute[74261]:   <name>instance-00000013</name>
Oct 17 11:53:08 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:53:08 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:53:08 user nova-compute[74261]:   <metadata>
Oct 17 11:53:08 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:53:08 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:53:08 user nova-compute[74261]:       <nova:name>tempest-ServerActionsV293TestJSON-server-424524728</nova:name>
Oct 17 11:53:08 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:53:07</nova:creationTime>
Oct 17 11:53:08 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:53:08 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:53:08 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:53:08 user nova-compute[74261]:       <nova:owner>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:user uuid="9491905f6ed54a8cbe025f465f663b30">tempest-ServerActionsV293TestJSON-260506164-project-member</nova:user>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:project uuid="eb14118064e6484894e9b4a79ab37c84">tempest-ServerActionsV293TestJSON-260506164</nova:project>
Oct 17 11:53:08 user nova-compute[74261]:       </nova:owner>
Oct 17 11:53:08 user nova-compute[74261]:       <nova:ports>
Oct 17 11:53:08 user nova-compute[74261]:         <nova:port uuid="28011a4c-3b68-47de-a6cb-af96182da3e3">
Oct 17 11:53:08 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 11:53:08 user nova-compute[74261]:         </nova:port>
Oct 17 11:53:08 user nova-compute[74261]:       </nova:ports>
Oct 17 11:53:08 user nova-compute[74261]:     </nova:instance>
Oct 17 11:53:08 user nova-compute[74261]:   </metadata>
Oct 17 11:53:08 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:53:08 user nova-compute[74261]:     <system>
Oct 17 11:53:08 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:53:08 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:53:08 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:53:08 user nova-compute[74261]:       <entry name="serial">408f6bb4-f944-4043-8e61-a62ac7d49938</entry>
Oct 17 11:53:08 user nova-compute[74261]:       <entry name="uuid">408f6bb4-f944-4043-8e61-a62ac7d49938</entry>
Oct 17 11:53:08 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:53:08 user nova-compute[74261]:     </system>
Oct 17 11:53:08 user nova-compute[74261]:   </sysinfo>
Oct 17 11:53:08 user nova-compute[74261]:   <os>
Oct 17 11:53:08 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:53:08 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:53:08 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:53:08 user nova-compute[74261]:   </os>
Oct 17 11:53:08 user nova-compute[74261]:   <features>
Oct 17 11:53:08 user nova-compute[74261]:     <acpi/>
Oct 17 11:53:08 user nova-compute[74261]:     <apic/>
Oct 17 11:53:08 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:53:08 user nova-compute[74261]:   </features>
Oct 17 11:53:08 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:53:08 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:53:08 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:53:08 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:53:08 user nova-compute[74261]:   </clock>
Oct 17 11:53:08 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:53:08 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:53:08 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:53:08 user nova-compute[74261]:   </cpu>
Oct 17 11:53:08 user nova-compute[74261]:   <devices>
Oct 17 11:53:08 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:53:08 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:53:08 user nova-compute[74261]:       <source dev="/dev/sdf"/>
Oct 17 11:53:08 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:53:08 user nova-compute[74261]:       <serial>90be0a73-9516-46e6-b82a-f9e4d588d2a5</serial>
Oct 17 11:53:08 user nova-compute[74261]:     </disk>
Oct 17 11:53:08 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:53:08 user nova-compute[74261]:       <mac address="fa:16:3e:48:42:e5"/>
Oct 17 11:53:08 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:53:08 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:53:08 user nova-compute[74261]:       <target dev="tap28011a4c-3b"/>
Oct 17 11:53:08 user nova-compute[74261]:     </interface>
Oct 17 11:53:08 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:53:08 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938/console.log" append="off"/>
Oct 17 11:53:08 user nova-compute[74261]:     </serial>
Oct 17 11:53:08 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:53:08 user nova-compute[74261]:     <video>
Oct 17 11:53:08 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:53:08 user nova-compute[74261]:     </video>
Oct 17 11:53:08 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:53:08 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:53:08 user nova-compute[74261]:     </rng>
Oct 17 11:53:08 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:53:08 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:53:08 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:53:08 user nova-compute[74261]:     </memballoon>
Oct 17 11:53:08 user nova-compute[74261]:   </devices>
Oct 17 11:53:08 user nova-compute[74261]: </domain>
Oct 17 11:53:08 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424524728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-669144641',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe0H6TYJKtnM5UZxmp/5bHuEIzV0OVEDrIFCPQDY/SO41uj9ABVdiu5V1E6uGlhC8TuUzI7/t4NohLrqHWMbM7ORBEcE9rrb6hRtwcufBsxZzn5h8m8f0JBnSJcCA0d4g==',key_name='tempest-keypair-619756720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb14118064e6484894e9b4a79ab37c84',ramdisk_id='',reservation_id='r-7jcews07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-260506164',owner_user_name='tempest-ServerActionsV293TestJSON-260506164-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9491905f6ed54a8cbe025f465f663b30',uuid=408f6bb4-f944-4043-8e61-a62ac7d49938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converting VIF {"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG os_vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ae07d20-5afd-58ad-8b07-229747deaf89', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28011a4c-3b, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28011a4c-3b, col_values=(('qos', UUID('7facc0c1-af97-4826-af9f-93fe98c36d17')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28011a4c-3b, col_values=(('external_ids', {'iface-id': '28011a4c-3b68-47de-a6cb-af96182da3e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:42:e5', 'vm-uuid': '408f6bb4-f944-4043-8e61-a62ac7d49938'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:08 user nova-compute[74261]: INFO os_vif [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b')
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] No VIF found with MAC fa:16:3e:48:42:e5, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:53:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:53:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7382MB free_disk=25.39175033569336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f75b961a-6dc8-496f-b5e0-4c8967cc991d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a8ffb39b-874a-484d-9171-293bf5245fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0b77d95-170b-40bb-9336-3c0afa66e1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c1eee977-7ed6-441d-a103-d9c405bb46c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7130e449-0369-4b63-8c21-7f9239b44254 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 527e094a-0c2f-4867-bc71-29b05f4812da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:53:09 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:10 user nova-compute[74261]: INFO nova.compute.manager [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Terminating instance
Oct 17 11:53:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9dccd6d-43c6-4676-a0a1-aae08f373531 req-9bc7ab16-3e38-4c9d-a9aa-dd8559899775 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-vif-unplugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9dccd6d-43c6-4676-a0a1-aae08f373531 req-9bc7ab16-3e38-4c9d-a9aa-dd8559899775 service nova] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9dccd6d-43c6-4676-a0a1-aae08f373531 req-9bc7ab16-3e38-4c9d-a9aa-dd8559899775 service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9dccd6d-43c6-4676-a0a1-aae08f373531 req-9bc7ab16-3e38-4c9d-a9aa-dd8559899775 service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9dccd6d-43c6-4676-a0a1-aae08f373531 req-9bc7ab16-3e38-4c9d-a9aa-dd8559899775 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] No waiting events found dispatching network-vif-unplugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9dccd6d-43c6-4676-a0a1-aae08f373531 req-9bc7ab16-3e38-4c9d-a9aa-dd8559899775 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-vif-unplugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Skipping network cache update for instance because it is being deleted. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-30a2c593-aa38-4456-adc6-6a11b8d7f98b req-151c018d-a8e0-4e38-b38d-0b8f94d60f3b service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-30a2c593-aa38-4456-adc6-6a11b8d7f98b req-151c018d-a8e0-4e38-b38d-0b8f94d60f3b service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-30a2c593-aa38-4456-adc6-6a11b8d7f98b req-151c018d-a8e0-4e38-b38d-0b8f94d60f3b service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-30a2c593-aa38-4456-adc6-6a11b8d7f98b req-151c018d-a8e0-4e38-b38d-0b8f94d60f3b service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-30a2c593-aa38-4456-adc6-6a11b8d7f98b req-151c018d-a8e0-4e38-b38d-0b8f94d60f3b service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:11 user nova-compute[74261]: WARNING nova.compute.manager [req-30a2c593-aa38-4456-adc6-6a11b8d7f98b req-151c018d-a8e0-4e38-b38d-0b8f94d60f3b service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state rebuild_spawning.
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Instance destroyed successfully.
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lazy-loading 'resources' on Instance uuid f75b961a-6dc8-496f-b5e0-4c8967cc991d {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-949048204',display_name='tempest-ServersNegativeTestJSON-server-949048204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-949048204',id=3,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8bd718919439f8a804d2b74561f1d',ramdisk_id='',reservation_id='r-mxnw3ho9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1086864809',owner_user_name='tempest-ServersNegativeTestJSON-1086864809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:23Z,user_data=None,user_id='57dc5550d0fb4f0f8aaf2633b1ad6095',uuid=f75b961a-6dc8-496f-b5e0-4c8967cc991d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converting VIF {"id": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "address": "fa:16:3e:92:0c:b0", "network": {"id": "4093f654-97bd-4de6-b1c9-031a1ef260f9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407116967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8bd718919439f8a804d2b74561f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c59e2e-ee", "ovs_interfaceid": "13c59e2e-eebd-4a1e-87da-6ad926c4e716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG os_vif [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c59e2e-ee, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dc53feb-dff0-4717-801c-2ffc9d4f63cf) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:11 user nova-compute[74261]: INFO os_vif [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:0c:b0,bridge_name='br-int',has_traffic_filtering=True,id=13c59e2e-eebd-4a1e-87da-6ad926c4e716,network=Network(4093f654-97bd-4de6-b1c9-031a1ef260f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c59e2e-ee')
Oct 17 11:53:11 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Deleting instance files /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d_del
Oct 17 11:53:11 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Deletion of /opt/stack/data/nova/instances/f75b961a-6dc8-496f-b5e0-4c8967cc991d_del complete
Oct 17 11:53:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:11 user nova-compute[74261]: INFO nova.compute.manager [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [{"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-93fe26e6-4a68-4976-b53c-3c33250c20de" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:53:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:12 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Took 0.39 seconds to deallocate network for instance.
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:12 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Deleted allocations for instance f75b961a-6dc8-496f-b5e0-4c8967cc991d
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a7e1775d-239d-411c-9370-00207fc3480b tempest-ServersNegativeTestJSON-1086864809 tempest-ServersNegativeTestJSON-1086864809-project-member] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-80f62d99-5fe7-4ff2-905e-55a626f498a5 req-2a170641-2b98-4d68-a497-f80ca33157b9 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-80f62d99-5fe7-4ff2-905e-55a626f498a5 req-2a170641-2b98-4d68-a497-f80ca33157b9 service nova] Acquiring lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-80f62d99-5fe7-4ff2-905e-55a626f498a5 req-2a170641-2b98-4d68-a497-f80ca33157b9 service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-80f62d99-5fe7-4ff2-905e-55a626f498a5 req-2a170641-2b98-4d68-a497-f80ca33157b9 service nova] Lock "f75b961a-6dc8-496f-b5e0-4c8967cc991d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-80f62d99-5fe7-4ff2-905e-55a626f498a5 req-2a170641-2b98-4d68-a497-f80ca33157b9 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] No waiting events found dispatching network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:12 user nova-compute[74261]: WARNING nova.compute.manager [req-80f62d99-5fe7-4ff2-905e-55a626f498a5 req-2a170641-2b98-4d68-a497-f80ca33157b9 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received unexpected event network-vif-plugged-13c59e2e-eebd-4a1e-87da-6ad926c4e716 for instance with vm_state deleted and task_state None.
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:13 user nova-compute[74261]: WARNING nova.compute.manager [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state rebuild_spawning.
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-7966fbd3-545d-4a77-81bc-03cbb907a679 req-563563ef-9473-44d8-bad7-043cbfe43f07 service nova] [instance: f75b961a-6dc8-496f-b5e0-4c8967cc991d] Received event network-vif-deleted-13c59e2e-eebd-4a1e-87da-6ad926c4e716 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:53:13 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance spawned successfully.
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74261) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 17 11:53:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f74d00eb-e4c1-4ba0-959a-e6512770ff9d tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:18 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 is timed out.
Oct 17 11:53:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully detached device vdb from instance 0a85cfbd-143d-45e2-9529-71cdde5fad52 from the live domain config.
Oct 17 11:53:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZiurYUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:18 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[977966e3-3a98-4d04-a2fd-e798977e8e63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:53:18 user nova-compute[74261]: No targets found.
Oct 17 11:53:18 user nova-compute[74261]: iSNS:
Oct 17 11:53:18 user nova-compute[74261]: No targets found.
Oct 17 11:53:18 user nova-compute[74261]: STATIC:
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:53:18 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:18 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:18 user nova-compute[74261]: FIRMWARE:
Oct 17 11:53:18 user nova-compute[74261]: No targets found.
Oct 17 11:53:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:53:18 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:53:18 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832758b-4ddf-4134-b7c2-1dc285a99f3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6674ac-40b1-413d-ac3f-6b1972a0179b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b2426a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987'): ({'sde'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Removing single pathed devices sde {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8614ddcd-8f90-45f1-862b-db85be3f91aa]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb01bca3-b1f9-42c1-93cc-9915db563770]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flushing IO for device /dev/sde {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c5a52-c403-4673-a88f-98eec83bf695]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e1a250-b972-48c2-8b7c-c40ab2537a68]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e6ab35-f1ab-494e-bad1-7e07af4c927f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8367dc3-9f4d-4b9e-8033-da077e77705d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260]
Oct 17 11:53:19 user nova-compute[74261]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987, portal: 172.16.0.220,3260] successful.
Oct 17 11:53:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91af6ad-b594-4775-aa9e-cd8c6ad41987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[92574ae7-8714-4c20-9589-35dd55ed617c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== disconnect_volume: return (384ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:19 user nova-compute[74261]: INFO nova.compute.manager [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Detaching volume c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:53:19 user nova-compute[74261]: INFO nova.virt.block_device [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Attempting to driver detach volume c31109b2-0bfc-46e9-adb9-bdcbcba8a81f from mountpoint /dev/vdb
Oct 17 11:53:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Attempting to detach device vdb from instance a8ffb39b-874a-484d-9171-293bf5245fdd from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:53:19 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:53:19 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 11:53:19 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:53:19 user nova-compute[74261]:   <serial>c31109b2-0bfc-46e9-adb9-bdcbcba8a81f</serial>
Oct 17 11:53:19 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:53:19 user nova-compute[74261]: </disk>
Oct 17 11:53:19 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:53:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully detached device vdb from instance a8ffb39b-874a-484d-9171-293bf5245fdd from the persistent domain config.
Oct 17 11:53:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8ffb39b-874a-484d-9171-293bf5245fdd from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:53:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:53:19 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:53:19 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 11:53:19 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:53:19 user nova-compute[74261]:   <serial>c31109b2-0bfc-46e9-adb9-bdcbcba8a81f</serial>
Oct 17 11:53:19 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:53:19 user nova-compute[74261]: </disk>
Oct 17 11:53:19 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:53:20 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'flavor' on Instance uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a230bcb6-8659-40ab-8569-9c55455fb6df tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.227s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:53:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:26 user nova-compute[74261]: INFO nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Booting with volume abfe6402-5693-42cf-9002-57b65f0b8ee9 at /dev/vdc
Oct 17 11:53:26 user nova-compute[74261]: DEBUG os_brick.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3916c41-383b-42fb-b92a-837b2f4cb5bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[340fd1be-a053-40aa-a21f-30f0932ebc6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae9f61-297c-451e-a4cb-aba2d42188cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ede833-e04a-474c-a120-3fb8244269ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:53:26 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:53:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d52341-3e7e-4edd-9eaa-1dbc3944cb00]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG os_brick.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating existing volume attachment record: d5945f7f-3417-4c31-8fd7-2b0e771a190f {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:53:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "7d774988-6ac5-4701-a34e-64b99df1687e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:53:35 user nova-compute[74261]: INFO nova.compute.claims [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Claim successful on node user
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:53:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:53:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:53:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:35 user nova-compute[74261]: INFO nova.virt.block_device [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Booting with blank volume at /dev/vda
Oct 17 11:53:36 user nova-compute[74261]: DEBUG nova.policy [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d191be36a54216a9e2d6a64660e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b95f3129c4493b0a69149e5b8dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:53:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:36 user nova-compute[74261]: DEBUG nova.network.neutron [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Successfully created port: a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Successfully updated port: a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-changed-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Refreshing instance network info cache due to event network-changed-a00ccd63-87f9-450f-acc7-397289e3a14b. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] Acquiring lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-changed-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing instance network info cache due to event network-changed-84afda7e-7967-4683-9d57-7c83dc392312. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] Acquiring lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] Acquired lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Refreshing network info cache for port 84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance network_info: |[{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] Acquired lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Refreshing network info cache for port a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updated VIF entry in instance network info cache for port 84afda7e-7967-4683-9d57-7c83dc392312. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [{"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-626ef89d-1cbf-45be-8f98-0e6ea11b6719 req-57149248-3af2-415a-a98d-d5ef65d9407b service nova] Releasing lock "refresh_cache-c1eee977-7ed6-441d-a103-d9c405bb46c2" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updated VIF entry in instance network info cache for port a00ccd63-87f9-450f-acc7-397289e3a14b. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e9c84f59-9d61-4bd4-b5a5-98dc3599a0e3 req-8aeef123-6c89-4c39-a854-9ea2dc9d11b4 service nova] Releasing lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8ffb39b-874a-484d-9171-293bf5245fdd is timed out.
Oct 17 11:53:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully detached device vdb from instance a8ffb39b-874a-484d-9171-293bf5245fdd from the live domain config.
Oct 17 11:53:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqrODViG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ae2ed-2ee5-452a-a9dd-920b32351d24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:53:40 user nova-compute[74261]: No targets found.
Oct 17 11:53:40 user nova-compute[74261]: iSNS:
Oct 17 11:53:40 user nova-compute[74261]: No targets found.
Oct 17 11:53:40 user nova-compute[74261]: STATIC:
Oct 17 11:53:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:53:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074
Oct 17 11:53:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:53:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:53:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f
Oct 17 11:53:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:53:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:40 user nova-compute[74261]: FIRMWARE:
Oct 17 11:53:40 user nova-compute[74261]: No targets found.
Oct 17 11:53:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:53:40 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:53:40 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2787b50-050e-44da-8ac3-b1931f971068]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1064be-ab57-4118-95ff-0f665894f088]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2704c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f'): ({'sdd'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Removing single pathed devices sdd {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6baa34a-d38f-466c-a140-337b0b723b83]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7222e520-aba1-4d50-9f09-9e1852d3dc91]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flushing IO for device /dev/sdd {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46132f-b38e-48c7-80be-c1c91659b9fb]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c5e78-dc69-4186-91ed-0841afc5df68]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3fd2d3-c8b8-48e4-b6e7-fe29c6c44b1a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[44944d61-cc65-4790-8913-7b43b9452f29]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260]
Oct 17 11:53:40 user nova-compute[74261]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f, portal: 172.16.0.220,3260] successful.
Oct 17 11:53:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c31109b2-0bfc-46e9-adb9-bdcbcba8a81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1738c9-b07d-4a4a-a1b7-80d33368d272]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== disconnect_volume: return (322ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:40 user nova-compute[74261]: INFO nova.compute.manager [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Terminating instance
Oct 17 11:53:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-98e5ae02-5053-468d-a5d2-67080beaa033 req-4eee6c82-caa0-45cb-a0db-500774ddf91e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-98e5ae02-5053-468d-a5d2-67080beaa033 req-4eee6c82-caa0-45cb-a0db-500774ddf91e service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-98e5ae02-5053-468d-a5d2-67080beaa033 req-4eee6c82-caa0-45cb-a0db-500774ddf91e service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-98e5ae02-5053-468d-a5d2-67080beaa033 req-4eee6c82-caa0-45cb-a0db-500774ddf91e service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-98e5ae02-5053-468d-a5d2-67080beaa033 req-4eee6c82-caa0-45cb-a0db-500774ddf91e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-98e5ae02-5053-468d-a5d2-67080beaa033 req-4eee6c82-caa0-45cb-a0db-500774ddf91e service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-84afda7e-7967-4683-9d57-7c83dc392312 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-c8e359c2-ef3c-4f07-844e-b7a776964e99 req-8e15d2f3-59e2-4509-bbbe-005b7bfb9ae2 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c8e359c2-ef3c-4f07-844e-b7a776964e99 req-8e15d2f3-59e2-4509-bbbe-005b7bfb9ae2 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c8e359c2-ef3c-4f07-844e-b7a776964e99 req-8e15d2f3-59e2-4509-bbbe-005b7bfb9ae2 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c8e359c2-ef3c-4f07-844e-b7a776964e99 req-8e15d2f3-59e2-4509-bbbe-005b7bfb9ae2 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-c8e359c2-ef3c-4f07-844e-b7a776964e99 req-8e15d2f3-59e2-4509-bbbe-005b7bfb9ae2 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-c8e359c2-ef3c-4f07-844e-b7a776964e99 req-8e15d2f3-59e2-4509-bbbe-005b7bfb9ae2 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-be88a6be-10dc-415f-ad50-a792aa8e371b req-489e69bb-f6a2-446c-b94a-8ec01584a971 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-be88a6be-10dc-415f-ad50-a792aa8e371b req-489e69bb-f6a2-446c-b94a-8ec01584a971 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-be88a6be-10dc-415f-ad50-a792aa8e371b req-489e69bb-f6a2-446c-b94a-8ec01584a971 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-be88a6be-10dc-415f-ad50-a792aa8e371b req-489e69bb-f6a2-446c-b94a-8ec01584a971 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-be88a6be-10dc-415f-ad50-a792aa8e371b req-489e69bb-f6a2-446c-b94a-8ec01584a971 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-be88a6be-10dc-415f-ad50-a792aa8e371b req-489e69bb-f6a2-446c-b94a-8ec01584a971 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c91b933b-490f-4279-bc21-2588d84fb00f tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG os_brick.utils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b15047-32ce-4dbc-a4fd-921f9d16d5dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14c212-223a-4e60-9b6b-071d67644861]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b764fb7-9ea3-431e-8a5a-756b152ef746]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c9fc7-e227-406e-a6be-574159e9ddd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:53:41 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb8dbdc-0224-4ea6-b76b-7c057a2b1152]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG os_brick.utils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating existing volume attachment record: 2149903d-72ed-4ce6-9d97-00808d843bef {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.volume.cinder [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Update attachment failed for attachment d5945f7f-3417-4c31-8fd7-2b0e771a190f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Traceback (most recent call last):
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     driver_block_device.attach_block_devices(
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     _log_and_attach(device)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     bdm.attach(*attach_args, **attach_kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     self._do_attach(context, instance, volume, volume_api,
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     self._volume_attach(context, volume, connector, instance,
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     connection_info = volume_api.attachment_update(
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     res = method(self, ctx, *args, **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     with excutils.save_and_reraise_exception():
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     self.force_reraise()
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     raise self.value
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     return method.func(obj, *args, **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     resp = self._update('/attachments/%s' % id, body)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     return self.request(url, method, **kwargs)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254]     raise exceptions.from_response(resp, body)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea)
Oct 17 11:53:41 user nova-compute[74261]: ERROR nova.compute.manager [instance: 7130e449-0369-4b63-8c21-7f9239b44254] 
Oct 17 11:53:41 user nova-compute[74261]: DEBUG nova.compute.claims [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Aborting claim: <nova.compute.claims.Claim object at 0x7f8b0c1e0160> {{(pid=74261) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.712s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Build of instance 7130e449-0369-4b63-8c21-7f9239b44254 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea) {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.compute.utils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Build of instance 7130e449-0369-4b63-8c21-7f9239b44254 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74261) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 17 11:53:42 user nova-compute[74261]: ERROR nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Build of instance 7130e449-0369-4b63-8c21-7f9239b44254 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea): nova.exception.BuildAbortException: Build of instance 7130e449-0369-4b63-8c21-7f9239b44254 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8ef1fb3-b0a1-44c9-875d-cac7737968ea)
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Unplugging VIFs for instance {{(pid=74261) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "61eabd60-64db-456f-aa99-11fee2a0e88e", "address": "fa:16:3e:e4:18:fb", "network": {"id": "6c267cd3-bdab-47ef-9924-5d9199161cdb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-644081077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61eabd60-64", "ovs_interfaceid": "61eabd60-64db-456f-aa99-11fee2a0e88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:18:fb,bridge_name='br-int',has_traffic_filtering=True,id=61eabd60-64db-456f-aa99-11fee2a0e88e,network=Network(6c267cd3-bdab-47ef-9924-5d9199161cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61eabd60-64') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:18:fb,bridge_name='br-int',has_traffic_filtering=True,id=61eabd60-64db-456f-aa99-11fee2a0e88e,network=Network(6c267cd3-bdab-47ef-9924-5d9199161cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61eabd60-64') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61eabd60-64, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:18:fb,bridge_name='br-int',has_traffic_filtering=True,id=61eabd60-64db-456f-aa99-11fee2a0e88e,network=Network(6c267cd3-bdab-47ef-9924-5d9199161cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61eabd60-64')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "address": "fa:16:3e:e3:90:3b", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c050ab-76", "ovs_interfaceid": "d8c050ab-7691-4acb-aaed-7b8abe47c576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:90:3b,bridge_name='br-int',has_traffic_filtering=True,id=d8c050ab-7691-4acb-aaed-7b8abe47c576,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8c050ab-76') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:90:3b,bridge_name='br-int',has_traffic_filtering=True,id=d8c050ab-7691-4acb-aaed-7b8abe47c576,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8c050ab-76') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c050ab-76, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:90:3b,bridge_name='br-int',has_traffic_filtering=True,id=d8c050ab-7691-4acb-aaed-7b8abe47c576,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8c050ab-76')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "01fd110a-c709-4e4b-abda-4b420a8f4384", "address": "fa:16:3e:a5:40:4e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fd110a-c7", "ovs_interfaceid": "01fd110a-c709-4e4b-abda-4b420a8f4384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=01fd110a-c709-4e4b-abda-4b420a8f4384,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01fd110a-c7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=01fd110a-c709-4e4b-abda-4b420a8f4384,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01fd110a-c7') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01fd110a-c7, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Instance destroyed successfully.
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lazy-loading 'resources' on Instance uuid c1eee977-7ed6-441d-a103-d9c405bb46c2 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=01fd110a-c709-4e4b-abda-4b420a8f4384,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01fd110a-c7')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "address": "fa:16:3e:56:3f:3f", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae5f39c7-ac", "ovs_interfaceid": "ae5f39c7-acdb-4c45-aacb-2d419e596afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae5f39c7-acdb-4c45-aacb-2d419e596afc,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae5f39c7-ac') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae5f39c7-acdb-4c45-aacb-2d419e596afc,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae5f39c7-ac') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae5f39c7-ac, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "84afda7e-7967-4683-9d57-7c83dc392312", "address": "fa:16:3e:45:27:da", "network": {"id": "4fc3318d-35ad-4d15-bbff-08f79b545d75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-18514444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84afda7e-79", "ovs_interfaceid": "84afda7e-7967-4683-9d57-7c83dc392312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae5f39c7-acdb-4c45-aacb-2d419e596afc,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae5f39c7-ac')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "address": "fa:16:3e:6f:9b:5e", "network": {"id": "a8fa2039-0112-4835-92b3-63c99a62cf9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1806077987", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38547cef-bb", "ovs_interfaceid": "38547cef-bb1f-4f67-ac9e-3bbe63a92b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9b:5e,bridge_name='br-int',has_traffic_filtering=True,id=38547cef-bb1f-4f67-ac9e-3bbe63a92b3d,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38547cef-bb') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9b:5e,bridge_name='br-int',has_traffic_filtering=True,id=38547cef-bb1f-4f67-ac9e-3bbe63a92b3d,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38547cef-bb') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84afda7e-79, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38547cef-bb, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=505fc9b7-f777-4b0f-b56f-e2959aa7aa9c) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9b:5e,bridge_name='br-int',has_traffic_filtering=True,id=38547cef-bb1f-4f67-ac9e-3bbe63a92b3d,network=Network(a8fa2039-0112-4835-92b3-63c99a62cf9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38547cef-bb')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "4ad34283-a705-4454-be75-75eff88afab5", "address": "fa:16:3e:3d:23:e2", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad34283-a7", "ovs_interfaceid": "4ad34283-a705-4454-be75-75eff88afab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=4ad34283-a705-4454-be75-75eff88afab5,network=Network(8e64d644-4fd9-42e8-8a2b-03944d3ae196),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ad34283-a7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=4ad34283-a705-4454-be75-75eff88afab5,network=Network(8e64d644-4fd9-42e8-8a2b-03944d3ae196),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ad34283-a7') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ad34283-a7, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:da,bridge_name='br-int',has_traffic_filtering=True,id=84afda7e-7967-4683-9d57-7c83dc392312,network=Network(4fc3318d-35ad-4d15-bbff-08f79b545d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84afda7e-79')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=4ad34283-a705-4454-be75-75eff88afab5,network=Network(8e64d644-4fd9-42e8-8a2b-03944d3ae196),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ad34283-a7')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1875741001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1875741001',id=23,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gBUvTodxixNx5e8C24REIYFUWMDaSw7tMHH6bdd59QqYnAw1SvZidgR8s777fIntTurE24T/uqsEe3h0sc0w9zH/MoBeqJbNPwIDiGVx7Kff4kKaYWksZQ07tZB7aYg==',key_name='tempest-keypair-879670817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a8769cd3704a8bbd693daad61bec44',ramdisk_id='',reservation_id='r-ft2w72tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1493284196',owner_user_name='tempest-TaggedBootDevicesTest-1493284196-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb053d82ce98480599e4656ed6450466',uuid=7130e449-0369-4b63-8c21-7f9239b44254,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converting VIF {"id": "88359059-5e3f-47cd-a535-f3897a7ef19e", "address": "fa:16:3e:e9:6c:66", "network": {"id": "8e64d644-4fd9-42e8-8a2b-03944d3ae196", "bridge": "br-int", "label": "tempest-device-tagging-net2-2108739542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a8769cd3704a8bbd693daad61bec44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88359059-5e", "ovs_interfaceid": "88359059-5e3f-47cd-a535-f3897a7ef19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6c:66,bridge_name='br-int',has_traffic_filtering=True,id=88359059-5e3f-47cd-a535-f3897a7ef19e,network=Network(8e64d644-4fd9-42e8-8a2b-03944d3ae196),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88359059-5e') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6c:66,bridge_name='br-int',has_traffic_filtering=True,id=88359059-5e3f-47cd-a535-f3897a7ef19e,network=Network(8e64d644-4fd9-42e8-8a2b-03944d3ae196),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88359059-5e') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea1f42aa-e5, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88359059-5e, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76c4acc6-3905-4257-8c94-6fef193a8f68) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6c:66,bridge_name='br-int',has_traffic_filtering=True,id=88359059-5e3f-47cd-a535-f3897a7ef19e,network=Network(8e64d644-4fd9-42e8-8a2b-03944d3ae196),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88359059-5e')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Unplugged VIFs for instance {{(pid=74261) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=ea1f42aa-e5d8-4b29-ba47-871755d85574,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea1f42aa-e5')
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e20fc8e-bc, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ba68fde-eec6-4970-9a01-a2727ce9a367) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:eb,bridge_name='br-int',has_traffic_filtering=True,id=9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9e20fc8e-bc')
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27895229-c4, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98c18420-3b78-405f-a85f-62a611970b7d) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:06:1f,bridge_name='br-int',has_traffic_filtering=True,id=27895229-c4a0-4e7f-9e1f-140ebf689277,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27895229-c4')
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9cdb9d3-8b, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=024a5456-c226-48bd-92a7-018d59d889e4) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=a9cdb9d3-8b59-4a92-8390-f28a747e5b43,network=Network(d35c1da5-41fb-489d-aa81-7efd77537a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cdb9d3-8b')
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec778c2c-a3, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa0646e4-1617-44f8-8207-ab2387b26fb1) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-84afda7e-7967-4683-9d57-7c83dc392312 for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-27895229-c4a0-4e7f-9e1f-140ebf689277 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-27895229-c4a0-4e7f-9e1f-140ebf689277 for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-ec778c2c-a321-45f2-ba29-7bf336bd4286 for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-unplugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-unplugged-78070ea8-d7a7-4f7a-b584-6f1144412516 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-e999389a-f23b-4caa-bedb-fde2e1347c1f req-c8f572c6-3da0-4f68-b4b6-7205bc3e59d9 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-78070ea8-d7a7-4f7a-b584-6f1144412516 for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b2:a9,bridge_name='br-int',has_traffic_filtering=True,id=ec778c2c-a321-45f2-ba29-7bf336bd4286,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec778c2c-a3')
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1484698494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1484698494',id=22,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDczFevz8MBiyVUeTxMqV7DKWIDkFUOeibe+BaI9lS8PM2KgJUMEmBl6EEVZK0zOdxI8zfsCqDL2z/uAFC0tAgr38672yihI4FpDkUoXE4hFUWtNagEW6FcqM2eDVMXR8A==',key_name='tempest-keypair-887695352',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2f713455cc64f2590e5e714f50eb1fd',ramdisk_id='',reservation_id='r-16knbexz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1437954569',owner_user_name='tempest-TaggedBootDevicesTest_v242-1437954569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f23a8928f3f471dab8b2942438b24a5',uuid=c1eee977-7ed6-441d-a103-d9c405bb46c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converting VIF {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78070ea8-d7, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83784229-83fd-4303-82be-ba7d275af4fa) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:43 user nova-compute[74261]: INFO os_vif [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=78070ea8-d7a7-4f7a-b584-6f1144412516,network=Network(c9b008ae-e15b-4c34-940a-b654eb5e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78070ea8-d7')
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYchoSjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc9e0dc-4018-4905-99d2-4b530965e6eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]: iSNS:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]: STATIC:
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: FIRMWARE:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:53:43 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:53:43 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17472e8-5db2-4f73-8aa6-a0b054a7c7bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e83cac5-a52d-47a4-9b70-b5e594545f53]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c242200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92ad128-53c8-44fb-9325-95ab81eeaa53]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-40e5da44-ec4e-4daa-a8f8-bcafb1b270fd req-3fad3fd4-67dc-48c9-8411-b4d510ff0773 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-40e5da44-ec4e-4daa-a8f8-bcafb1b270fd req-3fad3fd4-67dc-48c9-8411-b4d510ff0773 service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-40e5da44-ec4e-4daa-a8f8-bcafb1b270fd req-3fad3fd4-67dc-48c9-8411-b4d510ff0773 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-40e5da44-ec4e-4daa-a8f8-bcafb1b270fd req-3fad3fd4-67dc-48c9-8411-b4d510ff0773 service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-40e5da44-ec4e-4daa-a8f8-bcafb1b270fd req-3fad3fd4-67dc-48c9-8411-b4d510ff0773 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-40e5da44-ec4e-4daa-a8f8-bcafb1b270fd req-3fad3fd4-67dc-48c9-8411-b4d510ff0773 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-ea1f42aa-e5d8-4b29-ba47-871755d85574 for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[825cbaa2-0764-4ab7-9d9f-4db8348f5d70]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[067bab9b-6982-4bb0-bff6-fe5de275ce9d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[af80936c-a5b7-4cb2-8735-56b865a402a3]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f60e11-0cf0-4795-925d-4e393cefbe6e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-a38c451e-2089-4684-9d8a-cda4dbe75a37 req-ec63e8d0-23cf-4b5b-9ec0-0abcdfb6112b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a38c451e-2089-4684-9d8a-cda4dbe75a37 req-ec63e8d0-23cf-4b5b-9ec0-0abcdfb6112b service nova] Acquiring lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a38c451e-2089-4684-9d8a-cda4dbe75a37 req-ec63e8d0-23cf-4b5b-9ec0-0abcdfb6112b service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a38c451e-2089-4684-9d8a-cda4dbe75a37 req-ec63e8d0-23cf-4b5b-9ec0-0abcdfb6112b service nova] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-a38c451e-2089-4684-9d8a-cda4dbe75a37 req-ec63e8d0-23cf-4b5b-9ec0-0abcdfb6112b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] No waiting events found dispatching network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING nova.compute.manager [req-a38c451e-2089-4684-9d8a-cda4dbe75a37 req-ec63e8d0-23cf-4b5b-9ec0-0abcdfb6112b service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received unexpected event network-vif-plugged-9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd for instance with vm_state active and task_state deleting.
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55f4679-bf3f-4b01-845b-760814f8826e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260]
Oct 17 11:53:43 user nova-compute[74261]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074, portal: 172.16.0.220,3260] successful.
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa100a5d-910d-48c2-8a43-911c402fd074 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cfd44b-fa68-40b0-a9a6-0f7639a56e1b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== disconnect_volume: return (344ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwuezmIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5825e7-18ab-42da-b590-26fa26d43290]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]: iSNS:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]: STATIC:
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: FIRMWARE:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:53:43 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:53:43 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[396977b9-290b-457a-bed7-75fa58bbc287]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bdb37a-65d5-4c64-87f8-45019dcd6f0d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b242316c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a'): ({'sdg'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Removing single pathed devices sdg {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9993e8e5-1bce-459b-93d0-712f1c5303d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cc736-ac6e-4e7e-8e9a-5f1bfe2538c3]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Flushing IO for device /dev/sdg {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e3a020-449e-4363-9a8f-2d94ad6a65b4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e636248-3bbf-4e9b-a1e9-ad323c63f500]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] SCSI volumes sdg have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b8aa6-12bc-43b9-8d33-65b858520063]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e650096d-85a3-42c2-8a0c-4e69e9b6e9aa]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260]
Oct 17 11:53:43 user nova-compute[74261]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a, portal: 172.16.0.220,3260] successful.
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b501dad5-4475-49bf-bdf6-fb0372d13a4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[949505ef-ee86-4de0-9ce0-1140f8dd429a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== disconnect_volume: return (310ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHkeXxBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:53:43 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[623151b3-3bf3-4059-9a8d-a2f15522e047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]: iSNS:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]: STATIC:
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:53:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:53:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:53:43 user nova-compute[74261]: FIRMWARE:
Oct 17 11:53:43 user nova-compute[74261]: No targets found.
Oct 17 11:53:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:53:43 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:53:43 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:53:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead99df1-2790-46df-a3d2-e6e1814ee35f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce90d323-3a62-4718-b678-0a00cf01b878]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:44 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:44 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 (non-flash)
Oct 17 11:53:44 user nova-compute[74261]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:53:44 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:53:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24393130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4bd88c-0106-440f-a307-e6af9ea10ba3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c43a3-0a1a-4b8f-ad09-1976a5cc6b14]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d72dd-6ad5-4c56-b34c-b263666b5a1f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d06587f-396c-4dd7-ba24-af3066019913]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[36981376-f077-45ff-a3e1-9ca84c498248]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcc1a72-6f0b-43b4-ac53-8cf89ac8c0be]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260]
Oct 17 11:53:44 user nova-compute[74261]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20, portal: 172.16.0.220,3260] successful.
Oct 17 11:53:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a070e7cb-9abe-41df-a7a8-a71a25fd5d20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58e8e0-7788-49c6-84fa-2257871678c3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] <== disconnect_volume: return (305ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:53:44 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Deleting instance files /opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2_del
Oct 17 11:53:44 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Deletion of /opt/stack/data/nova/instances/c1eee977-7ed6-441d-a103-d9c405bb46c2_del complete
Oct 17 11:53:44 user nova-compute[74261]: INFO nova.compute.manager [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Took 3.51 seconds to destroy the instance on the hypervisor.
Oct 17 11:53:44 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:53:44 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:53:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-f65c438e-f973-48bf-9622-115886d5676d req-ff1611f9-6016-4902-94bc-580619969789 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-deleted-84afda7e-7967-4683-9d57-7c83dc392312 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:46 user nova-compute[74261]: INFO nova.compute.manager [req-f65c438e-f973-48bf-9622-115886d5676d req-ff1611f9-6016-4902-94bc-580619969789 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Neutron deleted interface 84afda7e-7967-4683-9d57-7c83dc392312; detaching it from the instance and deleting it from the info cache
Oct 17 11:53:46 user nova-compute[74261]: DEBUG nova.network.neutron [req-f65c438e-f973-48bf-9622-115886d5676d req-ff1611f9-6016-4902-94bc-580619969789 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [{"id": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "address": "fa:16:3e:45:5f:6a", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1f42aa-e5", "ovs_interfaceid": "ea1f42aa-e5d8-4b29-ba47-871755d85574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "address": "fa:16:3e:a6:45:eb", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e20fc8e-bc", "ovs_interfaceid": "9e20fc8e-bc01-4b0b-b9f2-e0ea981285bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "27895229-c4a0-4e7f-9e1f-140ebf689277", "address": "fa:16:3e:b6:06:1f", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27895229-c4", "ovs_interfaceid": "27895229-c4a0-4e7f-9e1f-140ebf689277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "address": "fa:16:3e:3f:f3:08", "network": {"id": "d35c1da5-41fb-489d-aa81-7efd77537a4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-580874937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cdb9d3-8b", "ovs_interfaceid": "a9cdb9d3-8b59-4a92-8390-f28a747e5b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "address": "fa:16:3e:22:b2:a9", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec778c2c-a3", "ovs_interfaceid": "ec778c2c-a321-45f2-ba29-7bf336bd4286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78070ea8-d7a7-4f7a-b584-6f1144412516", "address": "fa:16:3e:fe:d1:df", "network": {"id": "c9b008ae-e15b-4c34-940a-b654eb5e221c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683131545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2f713455cc64f2590e5e714f50eb1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78070ea8-d7", "ovs_interfaceid": "78070ea8-d7a7-4f7a-b584-6f1144412516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:46 user nova-compute[74261]: INFO nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Took 3.56 seconds to deallocate network for instance.
Oct 17 11:53:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-f65c438e-f973-48bf-9622-115886d5676d req-ff1611f9-6016-4902-94bc-580619969789 service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Detach interface failed, port_id=84afda7e-7967-4683-9d57-7c83dc392312, reason: Instance c1eee977-7ed6-441d-a103-d9c405bb46c2 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 11:53:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Detaching volume: b1225cb2-191d-4748-9faf-e15a45e6a820 {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 17 11:53:46 user nova-compute[74261]: INFO nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Detaching volume b1225cb2-191d-4748-9faf-e15a45e6a820
Oct 17 11:53:46 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Skipping driver_detach during remote rebuild. {{(pid=74261) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 17 11:53:47 user nova-compute[74261]: WARNING nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Failed to detach volume: b1225cb2-191d-4748-9faf-e15a45e6a820 due to 'NoneType' object has no attribute 'devices'
Oct 17 11:53:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Detaching volume: 7db05946-3094-40bd-9a89-0a82aa7b8f6b {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 17 11:53:47 user nova-compute[74261]: INFO nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Detaching volume 7db05946-3094-40bd-9a89-0a82aa7b8f6b
Oct 17 11:53:47 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Skipping driver_detach during remote rebuild. {{(pid=74261) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 17 11:53:47 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:48 user nova-compute[74261]: INFO nova.compute.manager [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Rescuing
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:53:48 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Took 3.66 seconds to deallocate network for instance.
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:48 user nova-compute[74261]: WARNING nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Failed to detach volume: 7db05946-3094-40bd-9a89-0a82aa7b8f6b due to 'NoneType' object has no attribute 'devices'
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Detaching volume: abfe6402-5693-42cf-9002-57b65f0b8ee9 {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 17 11:53:48 user nova-compute[74261]: INFO nova.compute.manager [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Detaching volume abfe6402-5693-42cf-9002-57b65f0b8ee9
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1c454d7-c7ab-4a44-9898-84a0602e3bad req-cfe44535-17f7-4b29-ba9d-03362565d59a service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-deleted-78070ea8-d7a7-4f7a-b584-6f1144412516 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1c454d7-c7ab-4a44-9898-84a0602e3bad req-cfe44535-17f7-4b29-ba9d-03362565d59a service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-deleted-a9cdb9d3-8b59-4a92-8390-f28a747e5b43 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1c454d7-c7ab-4a44-9898-84a0602e3bad req-cfe44535-17f7-4b29-ba9d-03362565d59a service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-deleted-27895229-c4a0-4e7f-9e1f-140ebf689277 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1c454d7-c7ab-4a44-9898-84a0602e3bad req-cfe44535-17f7-4b29-ba9d-03362565d59a service nova] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Received event network-vif-deleted-ec778c2c-a321-45f2-ba29-7bf336bd4286 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] [instance: 7130e449-0369-4b63-8c21-7f9239b44254] Skipping driver_detach during remote rebuild. {{(pid=74261) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:48 user nova-compute[74261]: INFO nova.compute.manager [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Terminating instance
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:53:48 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Deleted allocations for instance 7130e449-0369-4b63-8c21-7f9239b44254
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-61827c7a-077e-4430-8f6c-ea7990370652 tempest-TaggedBootDevicesTest-1493284196 tempest-TaggedBootDevicesTest-1493284196-project-member] Lock "7130e449-0369-4b63-8c21-7f9239b44254" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.363s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-changed-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing instance network info cache due to event network-changed-56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG nova.network.neutron [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing network info cache for port 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.compute.manager [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Detaching volume cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.virt.block_device [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Attempting to driver detach volume cc845800-a79c-4d34-9c7d-8a46d04307f8 from mountpoint /dev/vdb
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Attempting to detach device vdb from instance f0b77d95-170b-40bb-9336-3c0afa66e1df from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:53:49 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:53:49 user nova-compute[74261]:   <source dev="/dev/sdh"/>
Oct 17 11:53:49 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:53:49 user nova-compute[74261]:   <serial>cc845800-a79c-4d34-9c7d-8a46d04307f8</serial>
Oct 17 11:53:49 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:53:49 user nova-compute[74261]: </disk>
Oct 17 11:53:49 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully detached device vdb from instance f0b77d95-170b-40bb-9336-3c0afa66e1df from the persistent domain config.
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0b77d95-170b-40bb-9336-3c0afa66e1df from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:53:49 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:53:49 user nova-compute[74261]:   <source dev="/dev/sdh"/>
Oct 17 11:53:49 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:53:49 user nova-compute[74261]:   <serial>cc845800-a79c-4d34-9c7d-8a46d04307f8</serial>
Oct 17 11:53:49 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:53:49 user nova-compute[74261]: </disk>
Oct 17 11:53:49 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updated VIF entry in instance network info cache for port 56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-06d0108f-d2bc-477b-90f8-2a9f5097f254 req-bcbcb584-73ee-4b30-bada-4b06234905e2 service nova] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance destroyed successfully.
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Attempting rescue
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74261) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Creating image(s)
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'trusted_certs' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-changed-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing instance network info cache due to event network-changed-56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Acquiring lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Acquired lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Refreshing network info cache for port 56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue" returned: 0 in 0.046s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'migration_context' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.base [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<dac3f877-dbbe-4593-b1a8-4c13b7c3382e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Start _get_guest_xml network_info=[{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:6e:2b:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'resources' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.base [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<dac3f877-dbbe-4593-b1a8-4c13b7c3382e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'numa_topology' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.base [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<dac3f877-dbbe-4593-b1a8-4c13b7c3382e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:53:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Instance destroyed successfully.
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'resources' on Instance uuid 0a85cfbd-143d-45e2-9529-71cdde5fad52 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:49 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:53:49 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1162149465',display_name='tempest-ServerActionsTestOtherA-server-243977380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1162149465',id=14,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtR0YqoFrpPiXCoSahrCHnyzfIwThm6AY9VcZpOP9PuSc0xow/4PNQ5MD7rsPe3keZvknND3j9KNhoqBhKSvmX4b1Dq/mfceVXOpv9yoUBcd7t3YcYhCVRllEahAKNTig==',key_name='tempest-keypair-848116821',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-xt5s6fce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=0a85cfbd-143d-45e2-9529-71cdde5fad52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "address": "fa:16:3e:51:4f:dc", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cbb1c4-52", "ovs_interfaceid": "f8cbb1c4-5281-4d70-b56b-2ae92919975d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG os_vif [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8cbb1c4-52, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'vcpu_model' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f53b8ec0-5474-4f5d-8cd0-ffdf6f4dd32e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.objects.base [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<dac3f877-dbbe-4593-b1a8-4c13b7c3382e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-108849629',display_name='tempest-ServerRescueNegativeTestJSON-server-108849629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-108849629',id=16,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-1l47gkmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:49:10Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=dac3f877-dbbe-4593-b1a8-4c13b7c3382e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:6e:2b:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:6e:2b:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'pci_devices' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:50 user nova-compute[74261]: INFO os_vif [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:4f:dc,bridge_name='br-int',has_traffic_filtering=True,id=f8cbb1c4-5281-4d70-b56b-2ae92919975d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cbb1c4-52')
Oct 17 11:53:50 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Deleting instance files /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52_del
Oct 17 11:53:50 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Deletion of /opt/stack/data/nova/instances/0a85cfbd-143d-45e2-9529-71cdde5fad52_del complete
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.objects.base [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<dac3f877-dbbe-4593-b1a8-4c13b7c3382e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:53:50 user nova-compute[74261]:   <uuid>dac3f877-dbbe-4593-b1a8-4c13b7c3382e</uuid>
Oct 17 11:53:50 user nova-compute[74261]:   <name>instance-00000010</name>
Oct 17 11:53:50 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:53:50 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:53:50 user nova-compute[74261]:   <metadata>
Oct 17 11:53:50 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:53:50 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:53:50 user nova-compute[74261]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-108849629</nova:name>
Oct 17 11:53:50 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:53:49</nova:creationTime>
Oct 17 11:53:50 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:53:50 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:53:50 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:53:50 user nova-compute[74261]:       <nova:owner>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:user uuid="171d1037b5b74e09812373e40ef7c193">tempest-ServerRescueNegativeTestJSON-1673978463-project-member</nova:user>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:project uuid="ed0a71e6e0274702b67351ba09b91c7f">tempest-ServerRescueNegativeTestJSON-1673978463</nova:project>
Oct 17 11:53:50 user nova-compute[74261]:       </nova:owner>
Oct 17 11:53:50 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:53:50 user nova-compute[74261]:       <nova:ports>
Oct 17 11:53:50 user nova-compute[74261]:         <nova:port uuid="03525b1a-3365-4e16-a0f9-254421d22c50">
Oct 17 11:53:50 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 11:53:50 user nova-compute[74261]:         </nova:port>
Oct 17 11:53:50 user nova-compute[74261]:       </nova:ports>
Oct 17 11:53:50 user nova-compute[74261]:     </nova:instance>
Oct 17 11:53:50 user nova-compute[74261]:   </metadata>
Oct 17 11:53:50 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:53:50 user nova-compute[74261]:     <system>
Oct 17 11:53:50 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:53:50 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:53:50 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:53:50 user nova-compute[74261]:       <entry name="serial">dac3f877-dbbe-4593-b1a8-4c13b7c3382e</entry>
Oct 17 11:53:50 user nova-compute[74261]:       <entry name="uuid">dac3f877-dbbe-4593-b1a8-4c13b7c3382e</entry>
Oct 17 11:53:50 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:53:50 user nova-compute[74261]:     </system>
Oct 17 11:53:50 user nova-compute[74261]:   </sysinfo>
Oct 17 11:53:50 user nova-compute[74261]:   <os>
Oct 17 11:53:50 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:53:50 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:53:50 user nova-compute[74261]:   </os>
Oct 17 11:53:50 user nova-compute[74261]:   <features>
Oct 17 11:53:50 user nova-compute[74261]:     <acpi/>
Oct 17 11:53:50 user nova-compute[74261]:     <apic/>
Oct 17 11:53:50 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:53:50 user nova-compute[74261]:   </features>
Oct 17 11:53:50 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:53:50 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:53:50 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:53:50 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:53:50 user nova-compute[74261]:   </clock>
Oct 17 11:53:50 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:53:50 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:53:50 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:53:50 user nova-compute[74261]:   </cpu>
Oct 17 11:53:50 user nova-compute[74261]:   <devices>
Oct 17 11:53:50 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:53:50 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:53:50 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue"/>
Oct 17 11:53:50 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:53:50 user nova-compute[74261]:     </disk>
Oct 17 11:53:50 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:53:50 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:53:50 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk"/>
Oct 17 11:53:50 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:53:50 user nova-compute[74261]:     </disk>
Oct 17 11:53:50 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:53:50 user nova-compute[74261]:       <mac address="fa:16:3e:6e:2b:3d"/>
Oct 17 11:53:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:53:50 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:53:50 user nova-compute[74261]:       <target dev="tap03525b1a-33"/>
Oct 17 11:53:50 user nova-compute[74261]:     </interface>
Oct 17 11:53:50 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:53:50 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/console.log" append="off"/>
Oct 17 11:53:50 user nova-compute[74261]:     </serial>
Oct 17 11:53:50 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:53:50 user nova-compute[74261]:     <video>
Oct 17 11:53:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:53:50 user nova-compute[74261]:     </video>
Oct 17 11:53:50 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:53:50 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:53:50 user nova-compute[74261]:     </rng>
Oct 17 11:53:50 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:53:50 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:53:50 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:53:50 user nova-compute[74261]:     </memballoon>
Oct 17 11:53:50 user nova-compute[74261]:   </devices>
Oct 17 11:53:50 user nova-compute[74261]: </domain>
Oct 17 11:53:50 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:53:50 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance destroyed successfully.
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:6e:2b:3d, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:53:50 user nova-compute[74261]: INFO nova.compute.manager [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updated VIF entry in instance network info cache for port 56109d31-799c-49e5-8609-5455df819324. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [{"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Releasing lock "refresh_cache-f0b77d95-170b-40bb-9336-3c0afa66e1df" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:50 user nova-compute[74261]: WARNING nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state active and task_state rescuing.
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:50 user nova-compute[74261]: WARNING nova.compute.manager [req-91ce03ef-181b-4708-a842-29b563dfb264 req-9d4161b7-78b0-4b90-84ce-8ac0339e363b service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state active and task_state rescuing.
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-unplugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-unplugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-unplugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] Acquiring lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] No waiting events found dispatching network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:50 user nova-compute[74261]: WARNING nova.compute.manager [req-82c0de6e-66fa-4b35-9ed4-cff2ce028209 req-bef415b0-7d69-4f36-a57b-1470ac1a9f6c service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received unexpected event network-vif-plugged-f8cbb1c4-5281-4d70-b56b-2ae92919975d for instance with vm_state active and task_state deleting.
Oct 17 11:53:51 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:53:51 user nova-compute[74261]: INFO nova.compute.manager [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] [instance: c1eee977-7ed6-441d-a103-d9c405bb46c2] Took 3.02 seconds to detach 3 volumes for instance.
Oct 17 11:53:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:51 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Took 1.03 seconds to deallocate network for instance.
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.441s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:51 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Deleted allocations for instance c1eee977-7ed6-441d-a103-d9c405bb46c2
Oct 17 11:53:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] [instance: 0a85cfbd-143d-45e2-9529-71cdde5fad52] Received event network-vif-deleted-f8cbb1c4-5281-4d70-b56b-2ae92919975d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:51 user nova-compute[74261]: WARNING nova.compute.manager [req-59259c8f-d2a4-46a9-b0db-a1f9ad7b4855 req-2512b0b0-d1a6-471f-a0c9-974453334dfd service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state active and task_state rescuing.
Oct 17 11:53:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-57174592-ffaa-4b68-89cc-bf136709e058 tempest-TaggedBootDevicesTest_v242-1437954569 tempest-TaggedBootDevicesTest_v242-1437954569-project-member] Lock "c1eee977-7ed6-441d-a103-d9c405bb46c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.034s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:52 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:53:52 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:53:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:52 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Deleted allocations for instance 0a85cfbd-143d-45e2-9529-71cdde5fad52
Oct 17 11:53:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93bc7522-5057-4302-b415-76cad0c226b6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "0a85cfbd-143d-45e2-9529-71cdde5fad52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-84a34da0-ce2d-421f-9425-6c44cbecc931 req-2262fb75-80cc-446c-bd09-44cf415392e1 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:53:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-84a34da0-ce2d-421f-9425-6c44cbecc931 req-2262fb75-80cc-446c-bd09-44cf415392e1 service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:53:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-84a34da0-ce2d-421f-9425-6c44cbecc931 req-2262fb75-80cc-446c-bd09-44cf415392e1 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:53:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-84a34da0-ce2d-421f-9425-6c44cbecc931 req-2262fb75-80cc-446c-bd09-44cf415392e1 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:53:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-84a34da0-ce2d-421f-9425-6c44cbecc931 req-2262fb75-80cc-446c-bd09-44cf415392e1 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:53:53 user nova-compute[74261]: WARNING nova.compute.manager [req-84a34da0-ce2d-421f-9425-6c44cbecc931 req-2262fb75-80cc-446c-bd09-44cf415392e1 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state active and task_state rescuing.
Oct 17 11:53:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b249c271-313f-4d9f-88ce-526ebb4dd274 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:53:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:53:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:53:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:54:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Creating image(s)
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Ensure instance console log exists: /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Start _get_guest_xml network_info=[{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '2149903d-72ed-4ce6-9d97-00808d843bef', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d774988-6ac5-4701-a34e-64b99df1687e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd92bb129-8243-435a-948e-6b01c4840ac7', 'serial': 'd92bb129-8243-435a-948e-6b01c4840ac7'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:54:00 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:54:00 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:54:00 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:54:00 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:54:00 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca4a467-1d58-4d7f-a024-c65d42cf8789]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:54:00 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0527f8-a1cb-41b1-8590-f6f7a7a434ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7] added
Oct 17 11:54:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d1b82-ff46-46e9-80a2-b42bdb45a8c7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba50236d-df03-461a-b321-3b6dbec83511]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJoPViuv {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJoPViuv" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8b1bc-c6ad-49c8-a8a6-349f44f47c66]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJoPViuv'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04ae9c-30bc-4c6f-aded-f252c1127f41]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[da09b0d1-70b0-42a4-849a-a438257da46e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e65c47-bd9f-4815-8fac-9748bf0ee1ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260]
Oct 17 11:54:01 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260] successful.
Oct 17 11:54:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2cd8d5-3765-4e04-8dd2-9802db76da47]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[189abdee-fa43-4bc3-a9b8-963488e6aeb3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:54:01 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf065ae-af7f-4c9b-b2cc-632db80af029]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:01 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23131656334373234', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131656334373234', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191587520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191587520',id=25,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-jqhchyl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:53:36Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=7d774988-6ac5-4701-a34e-64b99df1687e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:54:02 user nova-compute[74261]:   <uuid>7d774988-6ac5-4701-a34e-64b99df1687e</uuid>
Oct 17 11:54:02 user nova-compute[74261]:   <name>instance-00000019</name>
Oct 17 11:54:02 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:54:02 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:54:02 user nova-compute[74261]:   <metadata>
Oct 17 11:54:02 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:54:02 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:54:02 user nova-compute[74261]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-191587520</nova:name>
Oct 17 11:54:02 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:54:00</nova:creationTime>
Oct 17 11:54:02 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:54:02 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:54:02 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:54:02 user nova-compute[74261]:       <nova:owner>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:user uuid="19d191be36a54216a9e2d6a64660e582">tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member</nova:user>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:project uuid="022b95f3129c4493b0a69149e5b8dd4e">tempest-ServerBootFromVolumeStableRescueTest-1400453141</nova:project>
Oct 17 11:54:02 user nova-compute[74261]:       </nova:owner>
Oct 17 11:54:02 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:54:02 user nova-compute[74261]:       <nova:ports>
Oct 17 11:54:02 user nova-compute[74261]:         <nova:port uuid="a00ccd63-87f9-450f-acc7-397289e3a14b">
Oct 17 11:54:02 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:54:02 user nova-compute[74261]:         </nova:port>
Oct 17 11:54:02 user nova-compute[74261]:       </nova:ports>
Oct 17 11:54:02 user nova-compute[74261]:     </nova:instance>
Oct 17 11:54:02 user nova-compute[74261]:   </metadata>
Oct 17 11:54:02 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:54:02 user nova-compute[74261]:     <system>
Oct 17 11:54:02 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:54:02 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:54:02 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:54:02 user nova-compute[74261]:       <entry name="serial">7d774988-6ac5-4701-a34e-64b99df1687e</entry>
Oct 17 11:54:02 user nova-compute[74261]:       <entry name="uuid">7d774988-6ac5-4701-a34e-64b99df1687e</entry>
Oct 17 11:54:02 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:54:02 user nova-compute[74261]:     </system>
Oct 17 11:54:02 user nova-compute[74261]:   </sysinfo>
Oct 17 11:54:02 user nova-compute[74261]:   <os>
Oct 17 11:54:02 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:54:02 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:54:02 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:54:02 user nova-compute[74261]:   </os>
Oct 17 11:54:02 user nova-compute[74261]:   <features>
Oct 17 11:54:02 user nova-compute[74261]:     <acpi/>
Oct 17 11:54:02 user nova-compute[74261]:     <apic/>
Oct 17 11:54:02 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:54:02 user nova-compute[74261]:   </features>
Oct 17 11:54:02 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:54:02 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:54:02 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:54:02 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:54:02 user nova-compute[74261]:   </clock>
Oct 17 11:54:02 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:54:02 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:54:02 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:54:02 user nova-compute[74261]:   </cpu>
Oct 17 11:54:02 user nova-compute[74261]:   <devices>
Oct 17 11:54:02 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:54:02 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:54:02 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 11:54:02 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:54:02 user nova-compute[74261]:       <serial>d92bb129-8243-435a-948e-6b01c4840ac7</serial>
Oct 17 11:54:02 user nova-compute[74261]:     </disk>
Oct 17 11:54:02 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:54:02 user nova-compute[74261]:       <mac address="fa:16:3e:cf:33:a5"/>
Oct 17 11:54:02 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:54:02 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:54:02 user nova-compute[74261]:       <target dev="tapa00ccd63-87"/>
Oct 17 11:54:02 user nova-compute[74261]:     </interface>
Oct 17 11:54:02 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:54:02 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/console.log" append="off"/>
Oct 17 11:54:02 user nova-compute[74261]:     </serial>
Oct 17 11:54:02 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:54:02 user nova-compute[74261]:     <video>
Oct 17 11:54:02 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:54:02 user nova-compute[74261]:     </video>
Oct 17 11:54:02 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:54:02 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:54:02 user nova-compute[74261]:     </rng>
Oct 17 11:54:02 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:54:02 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:54:02 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:54:02 user nova-compute[74261]:     </memballoon>
Oct 17 11:54:02 user nova-compute[74261]:   </devices>
Oct 17 11:54:02 user nova-compute[74261]: </domain>
Oct 17 11:54:02 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191587520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191587520',id=25,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-jqhchyl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:53:36Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=7d774988-6ac5-4701-a34e-64b99df1687e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG os_vif [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b4c255b-f94d-5b95-8658-41fca613bb2c', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa00ccd63-87, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa00ccd63-87, col_values=(('qos', UUID('d8eb9a00-9b5a-4f6c-8d36-16756819ad7c')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa00ccd63-87, col_values=(('external_ids', {'iface-id': 'a00ccd63-87f9-450f-acc7-397289e3a14b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:33:a5', 'vm-uuid': '7d774988-6ac5-4701-a34e-64b99df1687e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:02 user nova-compute[74261]: INFO os_vif [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87')
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:54:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No VIF found with MAC fa:16:3e:cf:33:a5, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a01e18f-f083-4d2c-b927-3465dad0ca67 req-7305822b-75de-4f01-b6c8-72e60797a46c service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a01e18f-f083-4d2c-b927-3465dad0ca67 req-7305822b-75de-4f01-b6c8-72e60797a46c service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a01e18f-f083-4d2c-b927-3465dad0ca67 req-7305822b-75de-4f01-b6c8-72e60797a46c service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a01e18f-f083-4d2c-b927-3465dad0ca67 req-7305822b-75de-4f01-b6c8-72e60797a46c service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a01e18f-f083-4d2c-b927-3465dad0ca67 req-7305822b-75de-4f01-b6c8-72e60797a46c service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:03 user nova-compute[74261]: WARNING nova.compute.manager [req-7a01e18f-f083-4d2c-b927-3465dad0ca67 req-7305822b-75de-4f01-b6c8-72e60797a46c service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state building and task_state spawning.
Oct 17 11:54:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:54:05 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance spawned successfully.
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:54:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-242b3454-3c86-4ff8-9f31-7b848d34020e req-0f7f28f4-e323-48bc-829d-628c2ce0da7b service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-242b3454-3c86-4ff8-9f31-7b848d34020e req-0f7f28f4-e323-48bc-829d-628c2ce0da7b service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-242b3454-3c86-4ff8-9f31-7b848d34020e req-0f7f28f4-e323-48bc-829d-628c2ce0da7b service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-242b3454-3c86-4ff8-9f31-7b848d34020e req-0f7f28f4-e323-48bc-829d-628c2ce0da7b service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-242b3454-3c86-4ff8-9f31-7b848d34020e req-0f7f28f4-e323-48bc-829d-628c2ce0da7b service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:06 user nova-compute[74261]: WARNING nova.compute.manager [req-242b3454-3c86-4ff8-9f31-7b848d34020e req-0f7f28f4-e323-48bc-829d-628c2ce0da7b service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state building and task_state spawning.
Oct 17 11:54:06 user nova-compute[74261]: INFO nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 17 11:54:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:06 user nova-compute[74261]: INFO nova.compute.manager [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Took 30.98 seconds to build instance.
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6f433934-b951-4707-aa1d-f924c4608b4f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "7d774988-6ac5-4701-a34e-64b99df1687e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.099s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:54:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:54:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7380MB free_disk=25.405807495117188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 93fe26e6-4a68-4976-b53c-3c33250c20de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a8ffb39b-874a-484d-9171-293bf5245fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0b77d95-170b-40bb-9336-3c0afa66e1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 527e094a-0c2f-4867-bc71-29b05f4812da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:54:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0b77d95-170b-40bb-9336-3c0afa66e1df is timed out.
Oct 17 11:54:09 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully detached device vdb from instance f0b77d95-170b-40bb-9336-3c0afa66e1df from the live domain config.
Oct 17 11:54:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTtColfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:54:09 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:54:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aa2d22-8843-497e-9ea9-138170c5cdd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:54:09 user nova-compute[74261]: No targets found.
Oct 17 11:54:09 user nova-compute[74261]: iSNS:
Oct 17 11:54:09 user nova-compute[74261]: No targets found.
Oct 17 11:54:09 user nova-compute[74261]: STATIC:
Oct 17 11:54:09 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8
Oct 17 11:54:09 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:54:09 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:54:09 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:54:09 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:54:09 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:54:09 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:54:09 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:54:09 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:54:09 user nova-compute[74261]: FIRMWARE:
Oct 17 11:54:09 user nova-compute[74261]: No targets found.
Oct 17 11:54:09 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:54:09 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:54:09 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78771ce-11fd-4129-839f-298fc1253b68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1410a3b-9972-40b3-b611-84f613939839]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:54:10 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:10 user nova-compute[74261]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:54:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 (non-flash)
Oct 17 11:54:10 user nova-compute[74261]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:10 user nova-compute[74261]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:54:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c271b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8'): ({'sdh'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Removing single pathed devices sdh {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a9753-728a-445c-87b9-90ef4bbb5dd9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8450654a-4251-4d78-aa0a-5e327bd128ca]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flushing IO for device /dev/sdh {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:54:10 user nova-compute[74261]: INFO nova.compute.manager [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Terminating instance
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.754s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2984fd-f95e-435a-ace2-92a660cc5a0d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[23752740-7d12-4c75-bb70-d744d6f23bac]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] SCSI volumes sdh have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[443970a4-e001-4fee-8bed-df7c1eeefd2b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5918217-aa4d-4182-9199-1c2a934e178f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260]
Oct 17 11:54:10 user nova-compute[74261]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8, portal: 172.16.0.220,3260] successful.
Oct 17 11:54:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc845800-a79c-4d34-9c7d-8a46d04307f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[035ce475-dda2-4d74-bfb9-2a24b18e147d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== disconnect_volume: return (413ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-24adcc64-d6f9-4671-bbec-3765b5715000 req-ddafacf5-322b-4744-b109-06840fcaa32d service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-vif-unplugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-24adcc64-d6f9-4671-bbec-3765b5715000 req-ddafacf5-322b-4744-b109-06840fcaa32d service nova] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-24adcc64-d6f9-4671-bbec-3765b5715000 req-ddafacf5-322b-4744-b109-06840fcaa32d service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-24adcc64-d6f9-4671-bbec-3765b5715000 req-ddafacf5-322b-4744-b109-06840fcaa32d service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-24adcc64-d6f9-4671-bbec-3765b5715000 req-ddafacf5-322b-4744-b109-06840fcaa32d service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] No waiting events found dispatching network-vif-unplugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-24adcc64-d6f9-4671-bbec-3765b5715000 req-ddafacf5-322b-4744-b109-06840fcaa32d service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-vif-unplugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:54:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Instance destroyed successfully.
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.objects.instance [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'resources' on Instance uuid a8ffb39b-874a-484d-9171-293bf5245fdd {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960084811',display_name='tempest-AttachVolumeNegativeTest-server-1960084811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960084811',id=15,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFVMwBC3cVbD2p4BrThPeCE+nrGRit6b1SsfGWcSI5EhTiJxiYJeLOs+KjaUWMZj19qH37v21L7TJVRbphJhRAXUmmhg4o193q677PnnysnVlm1y6JBO6ljbzWrZgaMxw==',key_name='tempest-keypair-497986224',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-ld35ey99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=a8ffb39b-874a-484d-9171-293bf5245fdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "address": "fa:16:3e:67:b9:e1", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb97e961-7b", "ovs_interfaceid": "fb97e961-7b9b-4ea0-9071-85eb30c77ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG os_vif [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb97e961-7b, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2b4ddec-29ee-4131-9c50-d8f5a0c96785) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:10 user nova-compute[74261]: INFO os_vif [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:b9:e1,bridge_name='br-int',has_traffic_filtering=True,id=fb97e961-7b9b-4ea0-9071-85eb30c77ef6,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb97e961-7b')
Oct 17 11:54:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Deleting instance files /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd_del
Oct 17 11:54:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Deletion of /opt/stack/data/nova/instances/a8ffb39b-874a-484d-9171-293bf5245fdd_del complete
Oct 17 11:54:11 user nova-compute[74261]: INFO nova.compute.manager [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Skipping network cache update for instance because it is being deleted. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'flavor' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c80b297a-c1ff-4342-a0d9-e382592a2852 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.170s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:11 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Took 0.83 seconds to deallocate network for instance.
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.compute.manager [req-de285159-ee33-4075-a71c-0acbd9045e49 req-435befcf-4ea4-43a0-bc59-91bbefe985e5 service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-vif-deleted-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:54:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:12 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Deleted allocations for instance a8ffb39b-874a-484d-9171-293bf5245fdd
Oct 17 11:54:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc158bc4-0bb4-4590-9b41-107a3c30806a tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-94a2e934-de84-4503-be26-a752faf24416 req-7df2e646-9660-446d-8c74-47bccb6d4a8b service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received event network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-94a2e934-de84-4503-be26-a752faf24416 req-7df2e646-9660-446d-8c74-47bccb6d4a8b service nova] Acquiring lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-94a2e934-de84-4503-be26-a752faf24416 req-7df2e646-9660-446d-8c74-47bccb6d4a8b service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-94a2e934-de84-4503-be26-a752faf24416 req-7df2e646-9660-446d-8c74-47bccb6d4a8b service nova] Lock "a8ffb39b-874a-484d-9171-293bf5245fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-94a2e934-de84-4503-be26-a752faf24416 req-7df2e646-9660-446d-8c74-47bccb6d4a8b service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] No waiting events found dispatching network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:12 user nova-compute[74261]: WARNING nova.compute.manager [req-94a2e934-de84-4503-be26-a752faf24416 req-7df2e646-9660-446d-8c74-47bccb6d4a8b service nova] [instance: a8ffb39b-874a-484d-9171-293bf5245fdd] Received unexpected event network-vif-plugged-fb97e961-7b9b-4ea0-9071-85eb30c77ef6 for instance with vm_state deleted and task_state None.
Oct 17 11:54:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing instance network info cache due to event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:54:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:54:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:54:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:54:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:41 user nova-compute[74261]: DEBUG nova.network.neutron [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updated VIF entry in instance network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:54:41 user nova-compute[74261]: DEBUG nova.network.neutron [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7fd87ed0-3e41-4176-9542-af3515878092 req-3fc65d37-fae3-4b45-ad17-e2be84192ef4 service nova] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:54:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:45 user nova-compute[74261]: INFO nova.compute.manager [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Terminating instance
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-6c4b5da3-a43a-400e-b3ae-04aaeed9e04c req-fe616f86-a5b8-4a77-bd8d-884d6ffb324b service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6c4b5da3-a43a-400e-b3ae-04aaeed9e04c req-fe616f86-a5b8-4a77-bd8d-884d6ffb324b service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6c4b5da3-a43a-400e-b3ae-04aaeed9e04c req-fe616f86-a5b8-4a77-bd8d-884d6ffb324b service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6c4b5da3-a43a-400e-b3ae-04aaeed9e04c req-fe616f86-a5b8-4a77-bd8d-884d6ffb324b service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-6c4b5da3-a43a-400e-b3ae-04aaeed9e04c req-fe616f86-a5b8-4a77-bd8d-884d6ffb324b service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-6c4b5da3-a43a-400e-b3ae-04aaeed9e04c req-fe616f86-a5b8-4a77-bd8d-884d6ffb324b service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-unplugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:54:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Instance destroyed successfully.
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.objects.instance [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'resources' on Instance uuid 93fe26e6-4a68-4976-b53c-3c33250c20de {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1703914465',display_name='tempest-AttachVolumeTestJSON-server-1703914465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1703914465',id=5,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4fhdmw+axarjZMfGW7mP8X6I5/GZ+Y1zyYYgsBa6DF6Cpvf52Qd1oZaTKW6WkvvTiInedvkmDKGGTI4J/+a+ZyJYOw61g/yP5Lp2uOmoIcYfizVYpdb9wPN6JaVMGVAA==',key_name='tempest-keypair-1732993241',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-p25jb8qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=93fe26e6-4a68-4976-b53c-3c33250c20de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "address": "fa:16:3e:83:f7:64", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf15dff2-7d", "ovs_interfaceid": "af15dff2-7dd0-449e-9cfa-9ae2135a43d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG os_vif [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf15dff2-7d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8637fbb7-f0ff-47af-8d98-3cad082a3f1d) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:45 user nova-compute[74261]: INFO os_vif [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=af15dff2-7dd0-449e-9cfa-9ae2135a43d4,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf15dff2-7d')
Oct 17 11:54:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Deleting instance files /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de_del
Oct 17 11:54:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Deletion of /opt/stack/data/nova/instances/93fe26e6-4a68-4976-b53c-3c33250c20de_del complete
Oct 17 11:54:45 user nova-compute[74261]: INFO nova.compute.manager [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 17 11:54:45 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:54:45 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:54:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:46 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:46 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Took 1.05 seconds to deallocate network for instance.
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-7367180f-64d9-4445-855c-cbded7e72b81 req-09a411d9-2e87-4e03-8315-373cac51ca4a service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-deleted-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-63483236-a31e-420e-a3b3-076c726d076a req-da01767b-a46b-40ca-abff-09653b52f630 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-63483236-a31e-420e-a3b3-076c726d076a req-da01767b-a46b-40ca-abff-09653b52f630 service nova] Acquiring lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-63483236-a31e-420e-a3b3-076c726d076a req-da01767b-a46b-40ca-abff-09653b52f630 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-63483236-a31e-420e-a3b3-076c726d076a req-da01767b-a46b-40ca-abff-09653b52f630 service nova] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-63483236-a31e-420e-a3b3-076c726d076a req-da01767b-a46b-40ca-abff-09653b52f630 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] No waiting events found dispatching network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:47 user nova-compute[74261]: WARNING nova.compute.manager [req-63483236-a31e-420e-a3b3-076c726d076a req-da01767b-a46b-40ca-abff-09653b52f630 service nova] [instance: 93fe26e6-4a68-4976-b53c-3c33250c20de] Received unexpected event network-vif-plugged-af15dff2-7dd0-449e-9cfa-9ae2135a43d4 for instance with vm_state deleted and task_state None.
Oct 17 11:54:47 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Deleted allocations for instance 93fe26e6-4a68-4976-b53c-3c33250c20de
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6818fd7d-a0a9-40a5-aac1-63913bfc5385 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "93fe26e6-4a68-4976-b53c-3c33250c20de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:47 user nova-compute[74261]: INFO nova.compute.manager [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Shelving
Oct 17 11:54:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c4af9128-40a7-4a87-acd4-786b07efeced req-4770d912-75ca-42ab-9974-cdebb04f9181 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4af9128-40a7-4a87-acd4-786b07efeced req-4770d912-75ca-42ab-9974-cdebb04f9181 service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4af9128-40a7-4a87-acd4-786b07efeced req-4770d912-75ca-42ab-9974-cdebb04f9181 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c4af9128-40a7-4a87-acd4-786b07efeced req-4770d912-75ca-42ab-9974-cdebb04f9181 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c4af9128-40a7-4a87-acd4-786b07efeced req-4770d912-75ca-42ab-9974-cdebb04f9181 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:48 user nova-compute[74261]: WARNING nova.compute.manager [req-c4af9128-40a7-4a87-acd4-786b07efeced req-4770d912-75ca-42ab-9974-cdebb04f9181 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state active and task_state shelving.
Oct 17 11:54:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance destroyed successfully.
Oct 17 11:54:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Beginning cold snapshot process
Oct 17 11:54:48 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:54:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk /opt/stack/data/nova/instances/snapshots/tmp3ly1jp7i/4691b006f8194b81b9f352d1e3835dc7 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk /opt/stack/data/nova/instances/snapshots/tmp3ly1jp7i/4691b006f8194b81b9f352d1e3835dc7" returned: 0 in 0.908s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Snapshot extracted, beginning image upload
Oct 17 11:54:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-549078ae-c7db-474a-a32d-2b04f99c6b85 req-df88f2db-5125-4569-b8f6-76d2a1938ed1 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-549078ae-c7db-474a-a32d-2b04f99c6b85 req-df88f2db-5125-4569-b8f6-76d2a1938ed1 service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-549078ae-c7db-474a-a32d-2b04f99c6b85 req-df88f2db-5125-4569-b8f6-76d2a1938ed1 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-549078ae-c7db-474a-a32d-2b04f99c6b85 req-df88f2db-5125-4569-b8f6-76d2a1938ed1 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-549078ae-c7db-474a-a32d-2b04f99c6b85 req-df88f2db-5125-4569-b8f6-76d2a1938ed1 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:50 user nova-compute[74261]: WARNING nova.compute.manager [req-549078ae-c7db-474a-a32d-2b04f99c6b85 req-df88f2db-5125-4569-b8f6-76d2a1938ed1 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state active and task_state shelving_image_uploading.
Oct 17 11:54:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Snapshot image upload complete
Oct 17 11:54:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:54:52 user nova-compute[74261]: INFO nova.compute.manager [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Shelve offloading
Oct 17 11:54:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance destroyed successfully.
Oct 17 11:54:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:54:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:54:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:54:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:54:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance destroyed successfully.
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'resources' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-51782779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-51782779',id=24,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrC/4RdHpsq2imB2jjET73dzW7Rr/DjghQOLDW/UXYyzTHfBfO+vwF8aWnMIpWcG/xgtbOFiamQbdpez9ykrHCxt9dVWgH7Pxt76oQ92kuIN21rgT0nv0bmhxcTaFNyw==',key_name='tempest-keypair-1685563374',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-vlytl2r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member',shelved_at='2023-10-17T11:54:52.401311',shelved_host='user',shelved_image_id='280341f5-7801-4ef6-99f3-07b10fe1f586'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=527e094a-0c2f-4867-bc71-29b05f4812da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG os_vif [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ef1b19a-36, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2901ab57-814f-4f29-a27e-c20323468215) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing instance network info cache due to event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.network.neutron [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:53 user nova-compute[74261]: INFO os_vif [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36')
Oct 17 11:54:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Deleting instance files /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da_del
Oct 17 11:54:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Deletion of /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da_del complete
Oct 17 11:54:53 user nova-compute[74261]: INFO nova.compute.manager [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Terminating instance
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Deleted allocations for instance 527e094a-0c2f-4867-bc71-29b05f4812da
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'numa_topology' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:53 user nova-compute[74261]: DEBUG nova.objects.base [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<527e094a-0c2f-4867-bc71-29b05f4812da> lazy-loaded attributes: resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3dc73db9-e7c3-4b3d-9f03-0c27f648d1c5 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.587s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.network.neutron [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updated VIF entry in instance network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.network.neutron [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1e3e9db3-44da-4bcf-bf95-35cdd961be5f req-c1617bde-4536-4a97-8ef9-5a2e5986f781 service nova] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Instance destroyed successfully.
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'resources' on Instance uuid f0b77d95-170b-40bb-9336-3c0afa66e1df {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-660772241',display_name='tempest-TestMinimumBasicScenario-server-660772241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-660772241',id=18,image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvoviKmRIWLhqx1/0v54FSfhcp38or1tfFwWW/M7aAdE030sOCxjF+2q5LfNWRzejEDrBKjI2pSldCHUoHdnMS81oeOCXOZ514/oXtGkD5pZKslf2vHEGeAmqjHXeQE0w==',key_name='tempest-TestMinimumBasicScenario-139334831',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-8ku7ekcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09bedbee-5fc2-43c9-ab9e-42698c7b6c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:08Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=f0b77d95-170b-40bb-9336-3c0afa66e1df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "56109d31-799c-49e5-8609-5455df819324", "address": "fa:16:3e:12:7a:2d", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56109d31-79", "ovs_interfaceid": "56109d31-799c-49e5-8609-5455df819324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG os_vif [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56109d31-79, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53e688bf-a72a-4c9b-8bd6-97f181c093c3) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:54 user nova-compute[74261]: INFO os_vif [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=56109d31-799c-49e5-8609-5455df819324,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56109d31-79')
Oct 17 11:54:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Deleting instance files /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df_del
Oct 17 11:54:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Deletion of /opt/stack/data/nova/instances/f0b77d95-170b-40bb-9336-3c0afa66e1df_del complete
Oct 17 11:54:54 user nova-compute[74261]: INFO nova.compute.manager [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 17 11:54:54 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:54:54 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:55 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Took 0.47 seconds to deallocate network for instance.
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:55 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Deleted allocations for instance f0b77d95-170b-40bb-9336-3c0afa66e1df
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-unplugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-unplugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:55 user nova-compute[74261]: WARNING nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-unplugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state deleted and task_state None.
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] Acquiring lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] No waiting events found dispatching network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:55 user nova-compute[74261]: WARNING nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received unexpected event network-vif-plugged-56109d31-799c-49e5-8609-5455df819324 for instance with vm_state deleted and task_state None.
Oct 17 11:54:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-ce02914b-6c98-460d-9bf2-2bbd40241da2 req-a5c91d2f-e1c9-460f-902c-3677acf25808 service nova] [instance: f0b77d95-170b-40bb-9336-3c0afa66e1df] Received event network-vif-deleted-56109d31-799c-49e5-8609-5455df819324 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-db1c80cd-4a25-4b86-b211-2b171997b6a0 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "f0b77d95-170b-40bb-9336-3c0afa66e1df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:56 user nova-compute[74261]: INFO nova.compute.manager [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Terminating instance
Oct 17 11:54:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-63ca8633-b373-436e-bc46-e1a2010cb6fe req-56f6bda5-6e25-4f7f-baea-42b2a58221e7 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-63ca8633-b373-436e-bc46-e1a2010cb6fe req-56f6bda5-6e25-4f7f-baea-42b2a58221e7 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-63ca8633-b373-436e-bc46-e1a2010cb6fe req-56f6bda5-6e25-4f7f-baea-42b2a58221e7 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-63ca8633-b373-436e-bc46-e1a2010cb6fe req-56f6bda5-6e25-4f7f-baea-42b2a58221e7 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-63ca8633-b373-436e-bc46-e1a2010cb6fe req-56f6bda5-6e25-4f7f-baea-42b2a58221e7 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-63ca8633-b373-436e-bc46-e1a2010cb6fe req-56f6bda5-6e25-4f7f-baea-42b2a58221e7 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Instance destroyed successfully.
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lazy-loading 'resources' on Instance uuid 408f6bb4-f944-4043-8e61-a62ac7d49938 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424524728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-669144641',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe0H6TYJKtnM5UZxmp/5bHuEIzV0OVEDrIFCPQDY/SO41uj9ABVdiu5V1E6uGlhC8TuUzI7/t4NohLrqHWMbM7ORBEcE9rrb6hRtwcufBsxZzn5h8m8f0JBnSJcCA0d4g==',key_name='tempest-keypair-619756720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb14118064e6484894e9b4a79ab37c84',ramdisk_id='',reservation_id='r-7jcews07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-260506164',owner_user_name='tempest-ServerActionsV293TestJSON-260506164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9491905f6ed54a8cbe025f465f663b30',uuid=408f6bb4-f944-4043-8e61-a62ac7d49938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converting VIF {"id": "28011a4c-3b68-47de-a6cb-af96182da3e3", "address": "fa:16:3e:48:42:e5", "network": {"id": "71ec4510-2c2a-46d7-a039-0631150db4f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-963792383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb14118064e6484894e9b4a79ab37c84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28011a4c-3b", "ovs_interfaceid": "28011a4c-3b68-47de-a6cb-af96182da3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_vif [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28011a4c-3b, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7facc0c1-af97-4826-af9f-93fe98c36d17) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:57 user nova-compute[74261]: INFO os_vif [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:42:e5,bridge_name='br-int',has_traffic_filtering=True,id=28011a4c-3b68-47de-a6cb-af96182da3e3,network=Network(71ec4510-2c2a-46d7-a039-0631150db4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28011a4c-3b')
Oct 17 11:54:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPBqHein', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:54:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c3911a-a164-4ba0-ab3f-76f1e64e8949]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:54:57 user nova-compute[74261]: No targets found.
Oct 17 11:54:57 user nova-compute[74261]: iSNS:
Oct 17 11:54:57 user nova-compute[74261]: No targets found.
Oct 17 11:54:57 user nova-compute[74261]: STATIC:
Oct 17 11:54:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:54:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:54:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:54:57 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5
Oct 17 11:54:57 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:54:57 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:54:57 user nova-compute[74261]: FIRMWARE:
Oct 17 11:54:57 user nova-compute[74261]: No targets found.
Oct 17 11:54:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:54:57 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:54:57 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61df34-da2d-483f-9117-ac8051a638ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1743fc66-76fc-48d7-8f25-f65369bcc636]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:57 user nova-compute[74261]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:54:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 (non-flash)
Oct 17 11:54:57 user nova-compute[74261]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:54:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24115750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5'): ({'sdf'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Removing single pathed devices sdf {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d9d477-be03-4832-be74-448b580f9d7e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfc5855-163e-4eb4-ae49-7177cb617463]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Flushing IO for device /dev/sdf {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8a6c7-69b2-4624-b754-2a7c528c3f9a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade9b10-6682-4193-8c48-c7b69665ee70]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23834633866663433', '/dev/disk/by-id/scsi-1SCST_BIO9324692d-84c8ff431dbff6a9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9324692d') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c14e86-a658-40b8-84ad-903c536f9526]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ca30a-70ba-48ad-ae05-b99be541358e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bd4656-3c0d-4c32-a002-fa00dd0facc5]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260]
Oct 17 11:54:57 user nova-compute[74261]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5, portal: 172.16.0.220,3260] successful.
Oct 17 11:54:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90be0a73-9516-46e6-b82a-f9e4d588d2a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272e022-f5d3-4038-aa42-a5cad625f7dd]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] <== disconnect_volume: return (336ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:54:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Deleting instance files /opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938_del
Oct 17 11:54:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Deletion of /opt/stack/data/nova/instances/408f6bb4-f944-4043-8e61-a62ac7d49938_del complete
Oct 17 11:54:58 user nova-compute[74261]: INFO nova.compute.manager [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 17 11:54:58 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:54:58 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:58 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Took 0.89 seconds to deallocate network for instance.
Oct 17 11:54:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-aeb29d36-fb8a-4316-a643-c492f9235ad0 req-d05baf0c-598a-40a4-a6e7-2ce9cbe7cf6a service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-deleted-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:58 user nova-compute[74261]: INFO nova.compute.manager [req-aeb29d36-fb8a-4316-a643-c492f9235ad0 req-d05baf0c-598a-40a4-a6e7-2ce9cbe7cf6a service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Neutron deleted interface 28011a4c-3b68-47de-a6cb-af96182da3e3; detaching it from the instance and deleting it from the info cache
Oct 17 11:54:58 user nova-compute[74261]: DEBUG nova.network.neutron [req-aeb29d36-fb8a-4316-a643-c492f9235ad0 req-d05baf0c-598a-40a4-a6e7-2ce9cbe7cf6a service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-aeb29d36-fb8a-4316-a643-c492f9235ad0 req-d05baf0c-598a-40a4-a6e7-2ce9cbe7cf6a service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Detach interface failed, port_id=28011a4c-3b68-47de-a6cb-af96182da3e3, reason: Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:59 user nova-compute[74261]: WARNING nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state deleting.
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:59 user nova-compute[74261]: WARNING nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state deleting.
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:59 user nova-compute[74261]: WARNING nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state deleting.
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-unplugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Acquiring lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:54:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] No waiting events found dispatching network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:54:59 user nova-compute[74261]: WARNING nova.compute.manager [req-81112030-92db-490d-9239-25426367561d req-84d779a9-1663-4aec-8397-5781fe5fc8a0 service nova] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Received unexpected event network-vif-plugged-28011a4c-3b68-47de-a6cb-af96182da3e3 for instance with vm_state active and task_state deleting.
Oct 17 11:55:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:55:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.407s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:55:05 user nova-compute[74261]: INFO nova.compute.claims [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Claim successful on node user
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG nova.network.neutron [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:55:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG nova.policy [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '126186127bc44a85ac39bb6bfbb0b8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe4687b8ef41248f726f6ddd948216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:55:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Creating image(s)
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk 1073741824" returned: 0 in 0.083s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.222s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG nova.network.neutron [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Successfully created port: 514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Cannot resize image /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Ensure instance console log exists: /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:08 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:08 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8181MB free_disk=25.455223083496094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 408f6bb4-f944-4043-8e61-a62ac7d49938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Successfully updated port: 514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquired lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-changed-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Refreshing instance network info cache due to event network-changed-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] Acquiring lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.network.neutron [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.888s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 11:55:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updating instance_info_cache with network_info: [{"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Releasing lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Instance network_info: |[{"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] Acquired lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Refreshing network info cache for port 514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Start _get_guest_xml network_info=[{"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:55:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-625886860',display_name='tempest-AttachVolumeNegativeTest-server-625886860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-625886860',id=26,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtky9NOHYajM6+Ut27mQVjzEWMjJq1newf16Gal3bSdRcgOWVjTYG9DO+6BszXgF4OD4yJRx6Tu9XemraPAKWkEdUtu6uIe/S8u13s+lRUt0KWMnIm9S7TWWoUs9s9oOQ==',key_name='tempest-keypair-327474104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-zbq0zfu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=d2a99562-808c-4d4a-bc06-ab50f7fa3972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'pci_devices' on Instance uuid d2a99562-808c-4d4a-bc06-ab50f7fa3972 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:55:09 user nova-compute[74261]:   <uuid>d2a99562-808c-4d4a-bc06-ab50f7fa3972</uuid>
Oct 17 11:55:09 user nova-compute[74261]:   <name>instance-0000001a</name>
Oct 17 11:55:09 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:55:09 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:55:09 user nova-compute[74261]:   <metadata>
Oct 17 11:55:09 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:55:09 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:55:09 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeNegativeTest-server-625886860</nova:name>
Oct 17 11:55:09 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:55:09</nova:creationTime>
Oct 17 11:55:09 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:55:09 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:55:09 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:55:09 user nova-compute[74261]:       <nova:owner>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:user uuid="126186127bc44a85ac39bb6bfbb0b8c6">tempest-AttachVolumeNegativeTest-1274994880-project-member</nova:user>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:project uuid="c2fe4687b8ef41248f726f6ddd948216">tempest-AttachVolumeNegativeTest-1274994880</nova:project>
Oct 17 11:55:09 user nova-compute[74261]:       </nova:owner>
Oct 17 11:55:09 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:55:09 user nova-compute[74261]:       <nova:ports>
Oct 17 11:55:09 user nova-compute[74261]:         <nova:port uuid="514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef">
Oct 17 11:55:09 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 11:55:09 user nova-compute[74261]:         </nova:port>
Oct 17 11:55:09 user nova-compute[74261]:       </nova:ports>
Oct 17 11:55:09 user nova-compute[74261]:     </nova:instance>
Oct 17 11:55:09 user nova-compute[74261]:   </metadata>
Oct 17 11:55:09 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:55:09 user nova-compute[74261]:     <system>
Oct 17 11:55:09 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:55:09 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:55:09 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:55:09 user nova-compute[74261]:       <entry name="serial">d2a99562-808c-4d4a-bc06-ab50f7fa3972</entry>
Oct 17 11:55:09 user nova-compute[74261]:       <entry name="uuid">d2a99562-808c-4d4a-bc06-ab50f7fa3972</entry>
Oct 17 11:55:09 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:55:09 user nova-compute[74261]:     </system>
Oct 17 11:55:09 user nova-compute[74261]:   </sysinfo>
Oct 17 11:55:09 user nova-compute[74261]:   <os>
Oct 17 11:55:09 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:55:09 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:55:09 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:55:09 user nova-compute[74261]:   </os>
Oct 17 11:55:09 user nova-compute[74261]:   <features>
Oct 17 11:55:09 user nova-compute[74261]:     <acpi/>
Oct 17 11:55:09 user nova-compute[74261]:     <apic/>
Oct 17 11:55:09 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:55:09 user nova-compute[74261]:   </features>
Oct 17 11:55:09 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:55:09 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:55:09 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:55:09 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:55:09 user nova-compute[74261]:   </clock>
Oct 17 11:55:09 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:55:09 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:55:09 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:55:09 user nova-compute[74261]:   </cpu>
Oct 17 11:55:09 user nova-compute[74261]:   <devices>
Oct 17 11:55:09 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:55:09 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:55:09 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk"/>
Oct 17 11:55:09 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:55:09 user nova-compute[74261]:     </disk>
Oct 17 11:55:09 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:55:09 user nova-compute[74261]:       <mac address="fa:16:3e:a3:73:4f"/>
Oct 17 11:55:09 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:09 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:55:09 user nova-compute[74261]:       <target dev="tap514c1f38-6b"/>
Oct 17 11:55:09 user nova-compute[74261]:     </interface>
Oct 17 11:55:09 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:55:09 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/console.log" append="off"/>
Oct 17 11:55:09 user nova-compute[74261]:     </serial>
Oct 17 11:55:09 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:55:09 user nova-compute[74261]:     <video>
Oct 17 11:55:09 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:09 user nova-compute[74261]:     </video>
Oct 17 11:55:09 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:55:09 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:55:09 user nova-compute[74261]:     </rng>
Oct 17 11:55:09 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:55:09 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:55:09 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:55:09 user nova-compute[74261]:     </memballoon>
Oct 17 11:55:09 user nova-compute[74261]:   </devices>
Oct 17 11:55:09 user nova-compute[74261]: </domain>
Oct 17 11:55:09 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-625886860',display_name='tempest-AttachVolumeNegativeTest-server-625886860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-625886860',id=26,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtky9NOHYajM6+Ut27mQVjzEWMjJq1newf16Gal3bSdRcgOWVjTYG9DO+6BszXgF4OD4yJRx6Tu9XemraPAKWkEdUtu6uIe/S8u13s+lRUt0KWMnIm9S7TWWoUs9s9oOQ==',key_name='tempest-keypair-327474104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-zbq0zfu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=d2a99562-808c-4d4a-bc06-ab50f7fa3972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG os_vif [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2389acaf-7e8c-548f-80d6-8b195c60582b', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap514c1f38-6b, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap514c1f38-6b, col_values=(('qos', UUID('d3150121-63d3-4c24-91e3-54595b2784a6')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap514c1f38-6b, col_values=(('external_ids', {'iface-id': '514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:73:4f', 'vm-uuid': 'd2a99562-808c-4d4a-bc06-ab50f7fa3972'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:09 user nova-compute[74261]: INFO os_vif [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b')
Oct 17 11:55:09 user nova-compute[74261]: INFO nova.compute.manager [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Took 10.23 seconds to detach 1 volumes for instance.
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] [instance: 408f6bb4-f944-4043-8e61-a62ac7d49938] Deleting volume: 90be0a73-9516-46e6-b82a-f9e4d588d2a5 {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:a3:73:4f, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updated VIF entry in instance network info cache for port 514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updating instance_info_cache with network_info: [{"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-676a4895-dd8f-44d4-be37-4f9805863c42 req-e6228279-4e6f-46c7-8a3f-1acf9dba6b8d service nova] Releasing lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:09 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Deleted allocations for instance 408f6bb4-f944-4043-8e61-a62ac7d49938
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d92a4e95-589f-4325-b78d-38df4dda37b5 tempest-ServerActionsV293TestJSON-260506164 tempest-ServerActionsV293TestJSON-260506164-project-member] Lock "408f6bb4-f944-4043-8e61-a62ac7d49938" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.016s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updating instance_info_cache with network_info: [{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-7e2b8a4e-81f6-49a1-b3bb-1ac5e45b8a37 req-8e296025-585e-4da9-8ae2-21831c61be37 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7e2b8a4e-81f6-49a1-b3bb-1ac5e45b8a37 req-8e296025-585e-4da9-8ae2-21831c61be37 service nova] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7e2b8a4e-81f6-49a1-b3bb-1ac5e45b8a37 req-8e296025-585e-4da9-8ae2-21831c61be37 service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7e2b8a4e-81f6-49a1-b3bb-1ac5e45b8a37 req-8e296025-585e-4da9-8ae2-21831c61be37 service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-7e2b8a4e-81f6-49a1-b3bb-1ac5e45b8a37 req-8e296025-585e-4da9-8ae2-21831c61be37 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] No waiting events found dispatching network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:10 user nova-compute[74261]: WARNING nova.compute.manager [req-7e2b8a4e-81f6-49a1-b3bb-1ac5e45b8a37 req-8e296025-585e-4da9-8ae2-21831c61be37 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received unexpected event network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef for instance with vm_state building and task_state spawning.
Oct 17 11:55:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:12 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:55:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-1603f7ea-12e6-41ce-b9d3-98c00c93ba4e req-5f2607fe-4968-4b7a-9ba4-5d649deff57c service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1603f7ea-12e6-41ce-b9d3-98c00c93ba4e req-5f2607fe-4968-4b7a-9ba4-5d649deff57c service nova] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1603f7ea-12e6-41ce-b9d3-98c00c93ba4e req-5f2607fe-4968-4b7a-9ba4-5d649deff57c service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1603f7ea-12e6-41ce-b9d3-98c00c93ba4e req-5f2607fe-4968-4b7a-9ba4-5d649deff57c service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-1603f7ea-12e6-41ce-b9d3-98c00c93ba4e req-5f2607fe-4968-4b7a-9ba4-5d649deff57c service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] No waiting events found dispatching network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:13 user nova-compute[74261]: WARNING nova.compute.manager [req-1603f7ea-12e6-41ce-b9d3-98c00c93ba4e req-5f2607fe-4968-4b7a-9ba4-5d649deff57c service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received unexpected event network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef for instance with vm_state building and task_state spawning.
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:55:13 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Instance spawned successfully.
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:13 user nova-compute[74261]: INFO nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Took 7.01 seconds to spawn the instance on the hypervisor.
Oct 17 11:55:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:55:13 user nova-compute[74261]: INFO nova.compute.manager [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Took 8.00 seconds to build instance.
Oct 17 11:55:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e74433c0-b858-4a18-8349-c5cb936c5369 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.113s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:26 user nova-compute[74261]: INFO nova.compute.manager [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Rescuing
Oct 17 11:55:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:26 user nova-compute[74261]: DEBUG nova.network.neutron [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:55:26 user nova-compute[74261]: DEBUG nova.network.neutron [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-dbf7528e-e896-43a8-9e5c-55da3b4578ae req-ad79e844-1130-46c5-9960-2ba97868c02d service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dbf7528e-e896-43a8-9e5c-55da3b4578ae req-ad79e844-1130-46c5-9960-2ba97868c02d service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dbf7528e-e896-43a8-9e5c-55da3b4578ae req-ad79e844-1130-46c5-9960-2ba97868c02d service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dbf7528e-e896-43a8-9e5c-55da3b4578ae req-ad79e844-1130-46c5-9960-2ba97868c02d service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-dbf7528e-e896-43a8-9e5c-55da3b4578ae req-ad79e844-1130-46c5-9960-2ba97868c02d service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:27 user nova-compute[74261]: WARNING nova.compute.manager [req-dbf7528e-e896-43a8-9e5c-55da3b4578ae req-ad79e844-1130-46c5-9960-2ba97868c02d service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state active and task_state rescuing.
Oct 17 11:55:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:27 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance destroyed successfully.
Oct 17 11:55:27 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Attempting a stable device rescue
Oct 17 11:55:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74261) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 11:55:27 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Creating image(s)
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG nova.objects.instance [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "baf3d35763a94bc934276af68c45cd28cb94378f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "baf3d35763a94bc934276af68c45cd28cb94378f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG nova.virt.images [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] 3f9dbb07-b871-40e9-9b2e-e2d83851447c was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.part /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-88fe8f00-ed9f-4596-a334-ef88b474c443 req-b4f5a1d8-9393-41a5-95e1-69a9a83b2a2c service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-88fe8f00-ed9f-4596-a334-ef88b474c443 req-b4f5a1d8-9393-41a5-95e1-69a9a83b2a2c service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-88fe8f00-ed9f-4596-a334-ef88b474c443 req-b4f5a1d8-9393-41a5-95e1-69a9a83b2a2c service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-88fe8f00-ed9f-4596-a334-ef88b474c443 req-b4f5a1d8-9393-41a5-95e1-69a9a83b2a2c service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-88fe8f00-ed9f-4596-a334-ef88b474c443 req-b4f5a1d8-9393-41a5-95e1-69a9a83b2a2c service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:29 user nova-compute[74261]: WARNING nova.compute.manager [req-88fe8f00-ed9f-4596-a334-ef88b474c443 req-b4f5a1d8-9393-41a5-95e1-69a9a83b2a2c service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state active and task_state rescuing.
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.part /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.converted" returned: 0 in 0.554s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "baf3d35763a94bc934276af68c45cd28cb94378f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.171s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "baf3d35763a94bc934276af68c45cd28cb94378f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "baf3d35763a94bc934276af68c45cd28cb94378f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f,backing_fmt=raw /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f,backing_fmt=raw /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue" returned: 0 in 0.070s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "baf3d35763a94bc934276af68c45cd28cb94378f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'migration_context' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<7d774988-6ac5-4701-a34e-64b99df1687e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Start _get_guest_xml network_info=[{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "vif_mac": "fa:16:3e:cf:33:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3f9dbb07-b871-40e9-9b2e-e2d83851447c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '2149903d-72ed-4ce6-9d97-00808d843bef', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7d774988-6ac5-4701-a34e-64b99df1687e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd92bb129-8243-435a-948e-6b01c4840ac7', 'serial': 'd92bb129-8243-435a-948e-6b01c4840ac7'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'resources' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<7d774988-6ac5-4701-a34e-64b99df1687e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<7d774988-6ac5-4701-a34e-64b99df1687e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:55:30 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:30 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<7d774988-6ac5-4701-a34e-64b99df1687e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:55:30 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:55:30 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:55:30 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedee9ec-d182-4b94-b6cc-a9eb7256a2b7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GJoPViuv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 17 11:55:30 user nova-compute[74261]: node.name = iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:55:30 user nova-compute[74261]: node.tpgt = -1
Oct 17 11:55:30 user nova-compute[74261]: node.startup = automatic
Oct 17 11:55:30 user nova-compute[74261]: node.leading_login = No
Oct 17 11:55:30 user nova-compute[74261]: iface.iscsi_ifacename = default
Oct 17 11:55:30 user nova-compute[74261]: iface.net_ifacename = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.ipaddress = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.prefix_len = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.hwaddress = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.transport_name = tcp
Oct 17 11:55:30 user nova-compute[74261]: iface.initiatorname = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.vlan_id = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.vlan_priority = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.vlan_state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.iface_num = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.mtu = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.port = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.bootproto = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.subnet_mask = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.gateway = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_alt_client_id_state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_alt_client_id = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_dns = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_learn_iqn = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_req_vendor_id_state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_vendor_id_state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_vendor_id = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.dhcp_slp_da = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.fragmentation = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.gratuitous_arp = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.incoming_forwarding = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.tos_state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.tos = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.ttl = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.delayed_ack = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.tcp_nagle = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.tcp_wsf_state = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.tcp_wsf = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.tcp_timer_scale = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.tcp_timestamp = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.redirect = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.def_task_mgmt_timeout = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.header_digest = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.data_digest = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.immediate_data = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.initial_r2t = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.data_seq_inorder = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.data_pdu_inorder = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.erl = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.max_receive_data_len = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.first_burst_len = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.max_outstanding_r2t = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.max_burst_len = 0
Oct 17 11:55:30 user nova-compute[74261]: iface.chap_auth = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.bidi_chap = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.strict_login_compliance = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.discovery_auth = <empty>
Oct 17 11:55:30 user nova-compute[74261]: iface.discovery_logout = <empty>
Oct 17 11:55:30 user nova-compute[74261]: node.discovery_address = <empty>
Oct 17 11:55:30 user nova-compute[74261]: node.discovery_port = 0
Oct 17 11:55:30 user nova-compute[74261]: node.discovery_type = static
Oct 17 11:55:30 user nova-compute[74261]: node.session.initial_cmdsn = 0
Oct 17 11:55:30 user nova-compute[74261]: node.session.initial_login_retry_max = 8
Oct 17 11:55:30 user nova-compute[74261]: node.session.xmit_thread_priority = -20
Oct 17 11:55:30 user nova-compute[74261]: node.session.cmds_max = 128
Oct 17 11:55:30 user nova-compute[74261]: node.session.queue_depth = 32
Oct 17 11:55:30 user nova-compute[74261]: node.session.nr_sessions = 1
Oct 17 11:55:30 user nova-compute[74261]: node.session.auth.authmethod = CHAP
Oct 17 11:55:30 user nova-compute[74261]: node.session.auth.username = GJoPViuv
Oct 17 11:55:30 user nova-compute[74261]: node.session.auth.password = ***
Oct 17 11:55:30 user nova-compute[74261]: node.session.auth.username_in = <empty>
Oct 17 11:55:30 user nova-compute[74261]: node.session.auth.password_in = <empty>
Oct 17 11:55:30 user nova-compute[74261]: node.session.auth.chap_algs = MD5
Oct 17 11:55:30 user nova-compute[74261]: node.session.timeo.replacement_timeout = 120
Oct 17 11:55:30 user nova-compute[74261]: node.session.err_timeo.abort_timeout = 15
Oct 17 11:55:30 user nova-compute[74261]: node.session.err_timeo.lu_reset_timeout = 30
Oct 17 11:55:30 user nova-compute[74261]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 17 11:55:30 user nova-compute[74261]: node.session.err_timeo.host_reset_timeout = 60
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.FastAbort = Yes
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.InitialR2T = No
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.ImmediateData = Yes
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.FirstBurstLength = 262144
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.MaxBurstLength = 16776192
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.DefaultTime2Retain = 0
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.DefaultTime2Wait = 2
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.MaxConnections = 1
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 17 11:55:30 user nova-compute[74261]: node.session.iscsi.ERL = 0
Oct 17 11:55:30 user nova-compute[74261]: node.session.scan = manual
Oct 17 11:55:30 user nova-compute[74261]: node.session.reopen_max = 0
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].address = 172.16.0.220
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].port = 3260
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].startup = manual
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].tcp.window_size = 524288
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].tcp.type_of_service = 0
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].timeo.logout_timeout = 15
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].timeo.login_timeout = 15
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].timeo.auth_timeout = 45
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].timeo.noop_out_interval = 5
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].timeo.noop_out_timeout = 5
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].iscsi.HeaderDigest = None
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].iscsi.DataDigest = None
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].iscsi.IFMarker = No
Oct 17 11:55:30 user nova-compute[74261]: node.conn[0].iscsi.OFMarker = No
Oct 17 11:55:30 user nova-compute[74261]: # END RECORD
Oct 17 11:55:30 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df7ebe-901e-463a-8fed-d8663b7901e3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aea0729-81c4-4109-9221-ed569f5ca54d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJoPViuv {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJoPViuv" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7280bb-d61c-49ae-8305-848c2ebb0b7f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJoPViuv'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e39a40b-32db-441e-863d-c8ee2fe11797]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d7b02d-32c2-4cf9-9f46-366bec9ec33a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:55:30 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:55:30 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] HCTL ('33', '0', '0', 0) found on session 24 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a97db9-ea8e-471e-bb18-fe076fce272d]: (4, ('0 0 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching for a device in session 24 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23131656334373234', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131656334373234', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191587520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191587520',id=25,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-jqhchyl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:54:06Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=7d774988-6ac5-4701-a34e-64b99df1687e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "vif_mac": "fa:16:3e:cf:33:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "vif_mac": "fa:16:3e:cf:33:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.objects.base [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<7d774988-6ac5-4701-a34e-64b99df1687e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:55:30 user nova-compute[74261]:   <uuid>7d774988-6ac5-4701-a34e-64b99df1687e</uuid>
Oct 17 11:55:30 user nova-compute[74261]:   <name>instance-00000019</name>
Oct 17 11:55:30 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:55:30 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:55:30 user nova-compute[74261]:   <metadata>
Oct 17 11:55:30 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:55:30 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:55:30 user nova-compute[74261]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-191587520</nova:name>
Oct 17 11:55:30 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:55:30</nova:creationTime>
Oct 17 11:55:30 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:55:30 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:55:30 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:55:30 user nova-compute[74261]:       <nova:owner>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:user uuid="19d191be36a54216a9e2d6a64660e582">tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member</nova:user>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:project uuid="022b95f3129c4493b0a69149e5b8dd4e">tempest-ServerBootFromVolumeStableRescueTest-1400453141</nova:project>
Oct 17 11:55:30 user nova-compute[74261]:       </nova:owner>
Oct 17 11:55:30 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:55:30 user nova-compute[74261]:       <nova:ports>
Oct 17 11:55:30 user nova-compute[74261]:         <nova:port uuid="a00ccd63-87f9-450f-acc7-397289e3a14b">
Oct 17 11:55:30 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:55:30 user nova-compute[74261]:         </nova:port>
Oct 17 11:55:30 user nova-compute[74261]:       </nova:ports>
Oct 17 11:55:30 user nova-compute[74261]:     </nova:instance>
Oct 17 11:55:30 user nova-compute[74261]:   </metadata>
Oct 17 11:55:30 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:55:30 user nova-compute[74261]:     <system>
Oct 17 11:55:30 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:55:30 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:55:30 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:55:30 user nova-compute[74261]:       <entry name="serial">7d774988-6ac5-4701-a34e-64b99df1687e</entry>
Oct 17 11:55:30 user nova-compute[74261]:       <entry name="uuid">7d774988-6ac5-4701-a34e-64b99df1687e</entry>
Oct 17 11:55:30 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:55:30 user nova-compute[74261]:     </system>
Oct 17 11:55:30 user nova-compute[74261]:   </sysinfo>
Oct 17 11:55:30 user nova-compute[74261]:   <os>
Oct 17 11:55:30 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:55:30 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:55:30 user nova-compute[74261]:   </os>
Oct 17 11:55:30 user nova-compute[74261]:   <features>
Oct 17 11:55:30 user nova-compute[74261]:     <acpi/>
Oct 17 11:55:30 user nova-compute[74261]:     <apic/>
Oct 17 11:55:30 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:55:30 user nova-compute[74261]:   </features>
Oct 17 11:55:30 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:55:30 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:55:30 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:55:30 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:55:30 user nova-compute[74261]:   </clock>
Oct 17 11:55:30 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:55:30 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:55:30 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:55:30 user nova-compute[74261]:   </cpu>
Oct 17 11:55:30 user nova-compute[74261]:   <devices>
Oct 17 11:55:30 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:55:30 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:55:30 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 11:55:30 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:55:30 user nova-compute[74261]:       <serial>d92bb129-8243-435a-948e-6b01c4840ac7</serial>
Oct 17 11:55:30 user nova-compute[74261]:     </disk>
Oct 17 11:55:30 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:55:30 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:55:30 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue"/>
Oct 17 11:55:30 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 11:55:30 user nova-compute[74261]:       <boot order="1"/>
Oct 17 11:55:30 user nova-compute[74261]:     </disk>
Oct 17 11:55:30 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:55:30 user nova-compute[74261]:       <mac address="fa:16:3e:cf:33:a5"/>
Oct 17 11:55:30 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:30 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:55:30 user nova-compute[74261]:       <target dev="tapa00ccd63-87"/>
Oct 17 11:55:30 user nova-compute[74261]:     </interface>
Oct 17 11:55:30 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:55:30 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/console.log" append="off"/>
Oct 17 11:55:30 user nova-compute[74261]:     </serial>
Oct 17 11:55:30 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:55:30 user nova-compute[74261]:     <video>
Oct 17 11:55:30 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:30 user nova-compute[74261]:     </video>
Oct 17 11:55:30 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:55:30 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:55:30 user nova-compute[74261]:     </rng>
Oct 17 11:55:30 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:55:30 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:55:30 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:55:30 user nova-compute[74261]:     </memballoon>
Oct 17 11:55:30 user nova-compute[74261]:   </devices>
Oct 17 11:55:30 user nova-compute[74261]: </domain>
Oct 17 11:55:30 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:55:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance destroyed successfully.
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:55:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No VIF found with MAC fa:16:3e:cf:33:a5, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:55:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-113b5f2c-6814-431e-a726-cb8ba72f5d92 req-1861ba2a-7700-411b-8c45-d7458c8b6617 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-113b5f2c-6814-431e-a726-cb8ba72f5d92 req-1861ba2a-7700-411b-8c45-d7458c8b6617 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-113b5f2c-6814-431e-a726-cb8ba72f5d92 req-1861ba2a-7700-411b-8c45-d7458c8b6617 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-113b5f2c-6814-431e-a726-cb8ba72f5d92 req-1861ba2a-7700-411b-8c45-d7458c8b6617 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-113b5f2c-6814-431e-a726-cb8ba72f5d92 req-1861ba2a-7700-411b-8c45-d7458c8b6617 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:32 user nova-compute[74261]: WARNING nova.compute.manager [req-113b5f2c-6814-431e-a726-cb8ba72f5d92 req-1861ba2a-7700-411b-8c45-d7458c8b6617 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state active and task_state rescuing.
Oct 17 11:55:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-3938157f-6967-4bf2-9bd9-9085843d0aff req-8a602b85-8855-4e19-916b-77eaf1add816 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3938157f-6967-4bf2-9bd9-9085843d0aff req-8a602b85-8855-4e19-916b-77eaf1add816 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3938157f-6967-4bf2-9bd9-9085843d0aff req-8a602b85-8855-4e19-916b-77eaf1add816 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3938157f-6967-4bf2-9bd9-9085843d0aff req-8a602b85-8855-4e19-916b-77eaf1add816 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-3938157f-6967-4bf2-9bd9-9085843d0aff req-8a602b85-8855-4e19-916b-77eaf1add816 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:34 user nova-compute[74261]: WARNING nova.compute.manager [req-3938157f-6967-4bf2-9bd9-9085843d0aff req-8a602b85-8855-4e19-916b-77eaf1add816 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state active and task_state rescuing.
Oct 17 11:55:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-673c8cdc-ea19-44fb-a63b-66d6b07791d1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:55:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:39 user nova-compute[74261]: INFO nova.compute.manager [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Unrescuing
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG nova.objects.instance [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'flavor' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-795249e2-3ee0-46fe-9acf-210246bea4fe req-f03a565a-2e99-48ff-8350-b9a85d3df4a1 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-795249e2-3ee0-46fe-9acf-210246bea4fe req-f03a565a-2e99-48ff-8350-b9a85d3df4a1 service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-795249e2-3ee0-46fe-9acf-210246bea4fe req-f03a565a-2e99-48ff-8350-b9a85d3df4a1 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-795249e2-3ee0-46fe-9acf-210246bea4fe req-f03a565a-2e99-48ff-8350-b9a85d3df4a1 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-795249e2-3ee0-46fe-9acf-210246bea4fe req-f03a565a-2e99-48ff-8350-b9a85d3df4a1 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:40 user nova-compute[74261]: WARNING nova.compute.manager [req-795249e2-3ee0-46fe-9acf-210246bea4fe req-f03a565a-2e99-48ff-8350-b9a85d3df4a1 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:55:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:55:40 user nova-compute[74261]: INFO nova.compute.claims [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Claim successful on node user
Oct 17 11:55:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance destroyed successfully.
Oct 17 11:55:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:55:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:55:40 user nova-compute[74261]: DEBUG nova.policy [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f0a17cbf46d422899c2dad6b8000fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ac99ae6b44e43ab599e1731d79b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:55:41 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Creating image(s)
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "/opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "/opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "/opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.255s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.259s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk 1073741824" returned: 0 in 0.075s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Successfully created port: c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-25655eb7-e380-417e-a807-17c724a35f51 req-876c1a71-711e-4971-8be8-24cddb0bfaef service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25655eb7-e380-417e-a807-17c724a35f51 req-876c1a71-711e-4971-8be8-24cddb0bfaef service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25655eb7-e380-417e-a807-17c724a35f51 req-876c1a71-711e-4971-8be8-24cddb0bfaef service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25655eb7-e380-417e-a807-17c724a35f51 req-876c1a71-711e-4971-8be8-24cddb0bfaef service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-25655eb7-e380-417e-a807-17c724a35f51 req-876c1a71-711e-4971-8be8-24cddb0bfaef service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:42 user nova-compute[74261]: WARNING nova.compute.manager [req-25655eb7-e380-417e-a807-17c724a35f51 req-876c1a71-711e-4971-8be8-24cddb0bfaef service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Cannot resize image /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Ensure instance console log exists: /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Successfully updated port: c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquired lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-changed-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Refreshing instance network info cache due to event network-changed-c974e6b3-e867-4d94-afde-4d8599a853c2. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] Acquiring lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updating instance_info_cache with network_info: [{"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Releasing lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Instance network_info: |[{"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] Acquired lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Refreshing network info cache for port c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Start _get_guest_xml network_info=[{"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:55:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912670388',display_name='tempest-AttachVolumeTestJSON-server-1912670388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912670388',id=27,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmCpERTYF5FwXZDWIliVyji4s+dDgm0DUDwrQygnwLKvAXz8LNMEHpKuqSv1Bu3hd9dVd9HQtKgFqpgzygI0bh731xWYlOJNN0svABPuDMEaIRNQbdsEg66ESHssfyLhw==',key_name='tempest-keypair-1015100600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-7wmxwmb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=c60a7acc-a630-4f9f-98ca-8bea9467cc9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.objects.instance [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'pci_devices' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:55:43 user nova-compute[74261]:   <uuid>c60a7acc-a630-4f9f-98ca-8bea9467cc9e</uuid>
Oct 17 11:55:43 user nova-compute[74261]:   <name>instance-0000001b</name>
Oct 17 11:55:43 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:55:43 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:55:43 user nova-compute[74261]:   <metadata>
Oct 17 11:55:43 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:55:43 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:55:43 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeTestJSON-server-1912670388</nova:name>
Oct 17 11:55:43 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:55:43</nova:creationTime>
Oct 17 11:55:43 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:55:43 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:55:43 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:55:43 user nova-compute[74261]:       <nova:owner>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:user uuid="0f0a17cbf46d422899c2dad6b8000fb3">tempest-AttachVolumeTestJSON-1691828841-project-member</nova:user>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:project uuid="743ac99ae6b44e43ab599e1731d79b3b">tempest-AttachVolumeTestJSON-1691828841</nova:project>
Oct 17 11:55:43 user nova-compute[74261]:       </nova:owner>
Oct 17 11:55:43 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:55:43 user nova-compute[74261]:       <nova:ports>
Oct 17 11:55:43 user nova-compute[74261]:         <nova:port uuid="c974e6b3-e867-4d94-afde-4d8599a853c2">
Oct 17 11:55:43 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 11:55:43 user nova-compute[74261]:         </nova:port>
Oct 17 11:55:43 user nova-compute[74261]:       </nova:ports>
Oct 17 11:55:43 user nova-compute[74261]:     </nova:instance>
Oct 17 11:55:43 user nova-compute[74261]:   </metadata>
Oct 17 11:55:43 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:55:43 user nova-compute[74261]:     <system>
Oct 17 11:55:43 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:55:43 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:55:43 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:55:43 user nova-compute[74261]:       <entry name="serial">c60a7acc-a630-4f9f-98ca-8bea9467cc9e</entry>
Oct 17 11:55:43 user nova-compute[74261]:       <entry name="uuid">c60a7acc-a630-4f9f-98ca-8bea9467cc9e</entry>
Oct 17 11:55:43 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:55:43 user nova-compute[74261]:     </system>
Oct 17 11:55:43 user nova-compute[74261]:   </sysinfo>
Oct 17 11:55:43 user nova-compute[74261]:   <os>
Oct 17 11:55:43 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:55:43 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:55:43 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:55:43 user nova-compute[74261]:   </os>
Oct 17 11:55:43 user nova-compute[74261]:   <features>
Oct 17 11:55:43 user nova-compute[74261]:     <acpi/>
Oct 17 11:55:43 user nova-compute[74261]:     <apic/>
Oct 17 11:55:43 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:55:43 user nova-compute[74261]:   </features>
Oct 17 11:55:43 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:55:43 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:55:43 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:55:43 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:55:43 user nova-compute[74261]:   </clock>
Oct 17 11:55:43 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:55:43 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:55:43 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:55:43 user nova-compute[74261]:   </cpu>
Oct 17 11:55:43 user nova-compute[74261]:   <devices>
Oct 17 11:55:43 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:55:43 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:55:43 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk"/>
Oct 17 11:55:43 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:55:43 user nova-compute[74261]:     </disk>
Oct 17 11:55:43 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:55:43 user nova-compute[74261]:       <mac address="fa:16:3e:b5:b4:71"/>
Oct 17 11:55:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:43 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:55:43 user nova-compute[74261]:       <target dev="tapc974e6b3-e8"/>
Oct 17 11:55:43 user nova-compute[74261]:     </interface>
Oct 17 11:55:43 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:55:43 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/console.log" append="off"/>
Oct 17 11:55:43 user nova-compute[74261]:     </serial>
Oct 17 11:55:43 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:55:43 user nova-compute[74261]:     <video>
Oct 17 11:55:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:43 user nova-compute[74261]:     </video>
Oct 17 11:55:43 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:55:43 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:55:43 user nova-compute[74261]:     </rng>
Oct 17 11:55:43 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:55:43 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:55:43 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:55:43 user nova-compute[74261]:     </memballoon>
Oct 17 11:55:43 user nova-compute[74261]:   </devices>
Oct 17 11:55:43 user nova-compute[74261]: </domain>
Oct 17 11:55:43 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912670388',display_name='tempest-AttachVolumeTestJSON-server-1912670388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912670388',id=27,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmCpERTYF5FwXZDWIliVyji4s+dDgm0DUDwrQygnwLKvAXz8LNMEHpKuqSv1Bu3hd9dVd9HQtKgFqpgzygI0bh731xWYlOJNN0svABPuDMEaIRNQbdsEg66ESHssfyLhw==',key_name='tempest-keypair-1015100600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-7wmxwmb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=c60a7acc-a630-4f9f-98ca-8bea9467cc9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG os_vif [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c5bb9aa-16f8-56de-9512-db5cd3869aca', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc974e6b3-e8, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc974e6b3-e8, col_values=(('qos', UUID('848f8e8f-9eef-404f-8b0f-93d94adaf4d5')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc974e6b3-e8, col_values=(('external_ids', {'iface-id': 'c974e6b3-e867-4d94-afde-4d8599a853c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b4:71', 'vm-uuid': 'c60a7acc-a630-4f9f-98ca-8bea9467cc9e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:43 user nova-compute[74261]: INFO os_vif [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8')
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No VIF found with MAC fa:16:3e:b5:b4:71, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updated VIF entry in instance network info cache for port c974e6b3-e867-4d94-afde-4d8599a853c2. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updating instance_info_cache with network_info: [{"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2bc6c2d2-4a3f-438d-846d-b743b36ba287 req-31abfcbb-16c2-4968-ad76-9b8c799e0dd1 service nova] Releasing lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:44 user nova-compute[74261]: WARNING nova.compute.manager [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:55:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:44 user nova-compute[74261]: WARNING nova.compute.manager [req-46c8cde4-04a2-41d4-8c56-ef9290a8dcda req-bd8f2d84-8d70-4c0a-a732-7f9f6dd2fa70 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:55:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dbcbb397-e056-460b-91db-fc3d24475b12 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:55:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:46 user nova-compute[74261]: WARNING nova.compute.manager [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received unexpected event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with vm_state building and task_state spawning.
Oct 17 11:55:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:46 user nova-compute[74261]: WARNING nova.compute.manager [req-915c77bb-37e9-4e3f-abd6-d4c3e882103c req-eab1412d-89b4-40ba-8bcc-c20222aa2ad4 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received unexpected event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with vm_state building and task_state spawning.
Oct 17 11:55:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:55:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Instance spawned successfully.
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:48 user nova-compute[74261]: INFO nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Took 7.00 seconds to spawn the instance on the hypervisor.
Oct 17 11:55:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:55:48 user nova-compute[74261]: INFO nova.compute.manager [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Took 8.16 seconds to build instance.
Oct 17 11:55:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-dfc37e23-a6b7-41a0-94dc-8e1ccf3a1ab0 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.334s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:55:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:55:49 user nova-compute[74261]: INFO nova.compute.claims [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Claim successful on node user
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:55:50 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.policy [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bfbfaa0fb2f4f7fbcdd7f8b98d784f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0813d99c95c47adb2b92394341409e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:55:50 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Creating image(s)
Oct 17 11:55:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "/opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "/opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "/opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "259e529f78ae674b8816466a0c3ef6ff7379949c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "259e529f78ae674b8816466a0c3ef6ff7379949c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Successfully created port: 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.part --force-share --output=json" returned: 0 in 0.232s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG nova.virt.images [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] fdd8e827-6442-4a0e-b7aa-1c38e77c33f2 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:55:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.part /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.part /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.converted" returned: 0 in 0.355s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "259e529f78ae674b8816466a0c3ef6ff7379949c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.517s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c --force-share --output=json" returned: 0 in 0.258s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "259e529f78ae674b8816466a0c3ef6ff7379949c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "259e529f78ae674b8816466a0c3ef6ff7379949c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Successfully updated port: 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c,backing_fmt=raw /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing instance network info cache due to event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c,backing_fmt=raw /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk 1073741824" returned: 0 in 0.072s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "259e529f78ae674b8816466a0c3ef6ff7379949c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c --force-share --output=json" returned: 0 in 0.244s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance network_info: |[{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.neutron [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Cannot resize image /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Ensure instance console log exists: /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Start _get_guest_xml network_info=[{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:55:45Z,direct_url=<?>,disk_format='qcow2',id=fdd8e827-6442-4a0e-b7aa-1c38e77c33f2,min_disk=0,min_ram=0,name='tempest-scenario-img--25014335',owner='f0813d99c95c47adb2b92394341409e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:55:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': 'fdd8e827-6442-4a0e-b7aa-1c38e77c33f2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:55:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:55:45Z,direct_url=<?>,disk_format='qcow2',id=fdd8e827-6442-4a0e-b7aa-1c38e77c33f2,min_disk=0,min_ram=0,name='tempest-scenario-img--25014335',owner='f0813d99c95c47adb2b92394341409e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:55:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1021692532',display_name='tempest-TestMinimumBasicScenario-server-1021692532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1021692532',id=28,image_ref='fdd8e827-6442-4a0e-b7aa-1c38e77c33f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+x632UK8Bx98rF8khzFSq+G9r8o4AXDsniYS/ck5lmJ2wPRvS4nPptWjM1CxsFzn65j2oUqHBbSC4t3C1Q3PU/HH85lPfc9rZ7hqDDuOQvig+3YfzrW3dZkmVgRfheg==',key_name='tempest-TestMinimumBasicScenario-307899441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-0ryi7bhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fdd8e827-6442-4a0e-b7aa-1c38e77c33f2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:55:51Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=76352fb0-a0b9-4b4b-b00e-b7878cdd4725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'pci_devices' on Instance uuid 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:55:53 user nova-compute[74261]:   <uuid>76352fb0-a0b9-4b4b-b00e-b7878cdd4725</uuid>
Oct 17 11:55:53 user nova-compute[74261]:   <name>instance-0000001c</name>
Oct 17 11:55:53 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:55:53 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:55:53 user nova-compute[74261]:   <metadata>
Oct 17 11:55:53 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:55:53 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:55:53 user nova-compute[74261]:       <nova:name>tempest-TestMinimumBasicScenario-server-1021692532</nova:name>
Oct 17 11:55:53 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:55:53</nova:creationTime>
Oct 17 11:55:53 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:55:53 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:55:53 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:55:53 user nova-compute[74261]:       <nova:owner>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:user uuid="4bfbfaa0fb2f4f7fbcdd7f8b98d784f9">tempest-TestMinimumBasicScenario-1183526091-project-member</nova:user>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:project uuid="f0813d99c95c47adb2b92394341409e8">tempest-TestMinimumBasicScenario-1183526091</nova:project>
Oct 17 11:55:53 user nova-compute[74261]:       </nova:owner>
Oct 17 11:55:53 user nova-compute[74261]:       <nova:root type="image" uuid="fdd8e827-6442-4a0e-b7aa-1c38e77c33f2"/>
Oct 17 11:55:53 user nova-compute[74261]:       <nova:ports>
Oct 17 11:55:53 user nova-compute[74261]:         <nova:port uuid="70a735cf-0293-43f6-8fcb-8bd26aa5d779">
Oct 17 11:55:53 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 11:55:53 user nova-compute[74261]:         </nova:port>
Oct 17 11:55:53 user nova-compute[74261]:       </nova:ports>
Oct 17 11:55:53 user nova-compute[74261]:     </nova:instance>
Oct 17 11:55:53 user nova-compute[74261]:   </metadata>
Oct 17 11:55:53 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:55:53 user nova-compute[74261]:     <system>
Oct 17 11:55:53 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:55:53 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:55:53 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:55:53 user nova-compute[74261]:       <entry name="serial">76352fb0-a0b9-4b4b-b00e-b7878cdd4725</entry>
Oct 17 11:55:53 user nova-compute[74261]:       <entry name="uuid">76352fb0-a0b9-4b4b-b00e-b7878cdd4725</entry>
Oct 17 11:55:53 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:55:53 user nova-compute[74261]:     </system>
Oct 17 11:55:53 user nova-compute[74261]:   </sysinfo>
Oct 17 11:55:53 user nova-compute[74261]:   <os>
Oct 17 11:55:53 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:55:53 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:55:53 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:55:53 user nova-compute[74261]:   </os>
Oct 17 11:55:53 user nova-compute[74261]:   <features>
Oct 17 11:55:53 user nova-compute[74261]:     <acpi/>
Oct 17 11:55:53 user nova-compute[74261]:     <apic/>
Oct 17 11:55:53 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:55:53 user nova-compute[74261]:   </features>
Oct 17 11:55:53 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:55:53 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:55:53 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:55:53 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:55:53 user nova-compute[74261]:   </clock>
Oct 17 11:55:53 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:55:53 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:55:53 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:55:53 user nova-compute[74261]:   </cpu>
Oct 17 11:55:53 user nova-compute[74261]:   <devices>
Oct 17 11:55:53 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:55:53 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:55:53 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk"/>
Oct 17 11:55:53 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:55:53 user nova-compute[74261]:     </disk>
Oct 17 11:55:53 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:55:53 user nova-compute[74261]:       <mac address="fa:16:3e:86:e0:fe"/>
Oct 17 11:55:53 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:53 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:55:53 user nova-compute[74261]:       <target dev="tap70a735cf-02"/>
Oct 17 11:55:53 user nova-compute[74261]:     </interface>
Oct 17 11:55:53 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:55:53 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/console.log" append="off"/>
Oct 17 11:55:53 user nova-compute[74261]:     </serial>
Oct 17 11:55:53 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:55:53 user nova-compute[74261]:     <video>
Oct 17 11:55:53 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:55:53 user nova-compute[74261]:     </video>
Oct 17 11:55:53 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:55:53 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:55:53 user nova-compute[74261]:     </rng>
Oct 17 11:55:53 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:55:53 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:55:53 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:55:53 user nova-compute[74261]:     </memballoon>
Oct 17 11:55:53 user nova-compute[74261]:   </devices>
Oct 17 11:55:53 user nova-compute[74261]: </domain>
Oct 17 11:55:53 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1021692532',display_name='tempest-TestMinimumBasicScenario-server-1021692532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1021692532',id=28,image_ref='fdd8e827-6442-4a0e-b7aa-1c38e77c33f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+x632UK8Bx98rF8khzFSq+G9r8o4AXDsniYS/ck5lmJ2wPRvS4nPptWjM1CxsFzn65j2oUqHBbSC4t3C1Q3PU/HH85lPfc9rZ7hqDDuOQvig+3YfzrW3dZkmVgRfheg==',key_name='tempest-TestMinimumBasicScenario-307899441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-0ryi7bhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fdd8e827-6442-4a0e-b7aa-1c38e77c33f2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:55:51Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=76352fb0-a0b9-4b4b-b00e-b7878cdd4725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG os_vif [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12562b78-46f0-5dd4-836f-78e144c25633', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70a735cf-02, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70a735cf-02, col_values=(('qos', UUID('1e2d2295-c6df-4fe3-9ea3-f902abfd2f2b')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70a735cf-02, col_values=(('external_ids', {'iface-id': '70a735cf-0293-43f6-8fcb-8bd26aa5d779', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:e0:fe', 'vm-uuid': '76352fb0-a0b9-4b4b-b00e-b7878cdd4725'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:53 user nova-compute[74261]: INFO os_vif [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02')
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:55:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No VIF found with MAC fa:16:3e:86:e0:fe, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:55:54 user nova-compute[74261]: DEBUG nova.network.neutron [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updated VIF entry in instance network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:55:54 user nova-compute[74261]: DEBUG nova.network.neutron [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:55:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7797a71e-acd4-49f9-9c3b-aa9b75c439c7 req-6c01ceda-196e-4888-bcf3-151c09208508 service nova] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:55:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-db58d3b9-c7c7-4226-91ba-11d2817c96fb req-79e1659b-3c79-4902-a6c4-bbf76013c95a service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-db58d3b9-c7c7-4226-91ba-11d2817c96fb req-79e1659b-3c79-4902-a6c4-bbf76013c95a service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-db58d3b9-c7c7-4226-91ba-11d2817c96fb req-79e1659b-3c79-4902-a6c4-bbf76013c95a service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-db58d3b9-c7c7-4226-91ba-11d2817c96fb req-79e1659b-3c79-4902-a6c4-bbf76013c95a service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-db58d3b9-c7c7-4226-91ba-11d2817c96fb req-79e1659b-3c79-4902-a6c4-bbf76013c95a service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:56 user nova-compute[74261]: WARNING nova.compute.manager [req-db58d3b9-c7c7-4226-91ba-11d2817c96fb req-79e1659b-3c79-4902-a6c4-bbf76013c95a service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state building and task_state spawning.
Oct 17 11:55:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-b3f577c7-2bf7-456c-b462-990ac09c19d7 req-d85b245d-d145-40bd-abf0-619ab1680134 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b3f577c7-2bf7-456c-b462-990ac09c19d7 req-d85b245d-d145-40bd-abf0-619ab1680134 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b3f577c7-2bf7-456c-b462-990ac09c19d7 req-d85b245d-d145-40bd-abf0-619ab1680134 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b3f577c7-2bf7-456c-b462-990ac09c19d7 req-d85b245d-d145-40bd-abf0-619ab1680134 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-b3f577c7-2bf7-456c-b462-990ac09c19d7 req-d85b245d-d145-40bd-abf0-619ab1680134 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:55:58 user nova-compute[74261]: WARNING nova.compute.manager [req-b3f577c7-2bf7-456c-b462-990ac09c19d7 req-d85b245d-d145-40bd-abf0-619ab1680134 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state building and task_state spawning.
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:55:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance spawned successfully.
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:55:58 user nova-compute[74261]: INFO nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Took 7.71 seconds to spawn the instance on the hypervisor.
Oct 17 11:55:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:55:58 user nova-compute[74261]: INFO nova.compute.manager [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Took 8.93 seconds to build instance.
Oct 17 11:55:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:55:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9ee7882c-f2f7-406f-9e75-8ea2780cd8f2 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.085s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:55:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.383s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:10 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:56:10 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=25.25927734375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:56:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:56:11 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:56:11 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:56:11 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:56:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:56:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:56:20 user nova-compute[74261]: INFO nova.compute.claims [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Claim successful on node user
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:56:20 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:56:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG nova.policy [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f29e0ea554e49c6b7ea83629e0f88c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92694390284b84b82715d4086494e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:56:21 user nova-compute[74261]: INFO nova.virt.block_device [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Booting with volume a9822d0e-a521-405d-9f3f-82ea5a209ca9 at /dev/vda
Oct 17 11:56:21 user nova-compute[74261]: DEBUG os_brick.utils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7167ba2b-df39-4e80-b18c-20d29fb54022]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c5880b-39cd-4dd0-9a8f-64bc065aff4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e7984-252c-4476-9e32-fbf425b9093e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d299ad-4e4a-4caa-80f9-9a6f52457eeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:56:21 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:56:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7def2e-d7da-4622-8e3e-da57e7fc6e9a]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG os_brick.utils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating existing volume attachment record: 3b300f42-6738-4841-ad2f-a60e40734993 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:56:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Successfully created port: 51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Successfully updated port: 51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-changed-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Refreshing instance network info cache due to event network-changed-51ae7fa5-0161-409c-b261-552e0fc76030. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] Acquiring lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance network_info: |[{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] Acquired lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:56:22 user nova-compute[74261]: DEBUG nova.network.neutron [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Refreshing network info cache for port 51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:56:23 user nova-compute[74261]: DEBUG nova.network.neutron [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updated VIF entry in instance network info cache for port 51ae7fa5-0161-409c-b261-552e0fc76030. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:56:23 user nova-compute[74261]: DEBUG nova.network.neutron [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:56:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7eb53567-6e1f-42dd-8ebc-2f9a97a7933d req-c8363a4a-d669-4b04-89a9-073f12a98229 service nova] Releasing lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:56:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:56:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Creating image(s)
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Ensure instance console log exists: /opt/stack/data/nova/instances/33e3905d-6e09-4b49-b1fe-deff0d677b1e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Start _get_guest_xml network_info=[{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '3b300f42-6738-4841-ad2f-a60e40734993', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33e3905d-6e09-4b49-b1fe-deff0d677b1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'serial': 'a9822d0e-a521-405d-9f3f-82ea5a209ca9'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:56:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:56:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:56:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:56:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:56:40 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecf4570-fcaf-462b-a9ae-ff96fe733927]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:56:40 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8bd451-86ea-4ef4-a623-d572ec65cad9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9] added
Oct 17 11:56:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27da752-9e78-4ca2-b5a5-68a1950f2b45]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc753f-4a97-4312-a6a7-2eaf6b3728d1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HjqrexZB {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HjqrexZB" returned: 0 in 0.056s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[03453aab-b271-44c6-a639-27811a6e8b6e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HjqrexZB'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f10a92a-20c2-4f68-91cd-b59011bbb286]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1652508e-be5b-493a-b45b-974062ed757c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:56:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:56:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6439450-c775-4eab-88c8-0a964cabacba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]
Oct 17 11:56:40 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.
Oct 17 11:56:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[30311d03-7a38-4d81-a248-d1337db82812]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[122d6085-69c1-43d5-bae0-4766a7c25338]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:56:40 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:56:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:56:40 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:56:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972726f-ca01-4156-bd04-0b4a6cc9c276]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:40 user nova-compute[74261]: INFO nova.compute.manager [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Unshelving
Oct 17 11:56:40 user nova-compute[74261]: INFO nova.virt.block_device [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Booting with volume f9803343-52c2-4a6c-966e-54f186769d20 at /dev/vdc
Oct 17 11:56:40 user nova-compute[74261]: DEBUG os_brick.utils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c33924-bc33-4dde-b134-d2cb5e39090b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7259220-9ab1-4dd3-ad64-0850d4fd3283]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[297d0c31-d0e0-45aa-8698-c20f185c8676]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1cb31-36bb-49fa-b588-d0e31862813e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:56:41 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:56:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc9578-c066-413f-9c25-6cc905cbbaf5]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.utils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating existing volume attachment record: 9bd955fe-ea76-4365-9223-398a49ab445e {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23333323763623962', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333323763623962', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-101703142',display_name='tempest-ServerActionsTestOtherA-server-101703142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-101703142',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-4d8tromd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=33e3905d-6e09-4b49-b1fe-deff0d677b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'pci_devices' on Instance uuid 33e3905d-6e09-4b49-b1fe-deff0d677b1e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:56:41 user nova-compute[74261]:   <uuid>33e3905d-6e09-4b49-b1fe-deff0d677b1e</uuid>
Oct 17 11:56:41 user nova-compute[74261]:   <name>instance-0000001d</name>
Oct 17 11:56:41 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:56:41 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:56:41 user nova-compute[74261]:   <metadata>
Oct 17 11:56:41 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:56:41 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:56:41 user nova-compute[74261]:       <nova:name>tempest-ServerActionsTestOtherA-server-101703142</nova:name>
Oct 17 11:56:41 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:56:40</nova:creationTime>
Oct 17 11:56:41 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:56:41 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:56:41 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:56:41 user nova-compute[74261]:       <nova:owner>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:user uuid="4f29e0ea554e49c6b7ea83629e0f88c6">tempest-ServerActionsTestOtherA-203196858-project-member</nova:user>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:project uuid="8e92694390284b84b82715d4086494e9">tempest-ServerActionsTestOtherA-203196858</nova:project>
Oct 17 11:56:41 user nova-compute[74261]:       </nova:owner>
Oct 17 11:56:41 user nova-compute[74261]:       <nova:ports>
Oct 17 11:56:41 user nova-compute[74261]:         <nova:port uuid="51ae7fa5-0161-409c-b261-552e0fc76030">
Oct 17 11:56:41 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 11:56:41 user nova-compute[74261]:         </nova:port>
Oct 17 11:56:41 user nova-compute[74261]:       </nova:ports>
Oct 17 11:56:41 user nova-compute[74261]:     </nova:instance>
Oct 17 11:56:41 user nova-compute[74261]:   </metadata>
Oct 17 11:56:41 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:56:41 user nova-compute[74261]:     <system>
Oct 17 11:56:41 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:56:41 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:56:41 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:56:41 user nova-compute[74261]:       <entry name="serial">33e3905d-6e09-4b49-b1fe-deff0d677b1e</entry>
Oct 17 11:56:41 user nova-compute[74261]:       <entry name="uuid">33e3905d-6e09-4b49-b1fe-deff0d677b1e</entry>
Oct 17 11:56:41 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:56:41 user nova-compute[74261]:     </system>
Oct 17 11:56:41 user nova-compute[74261]:   </sysinfo>
Oct 17 11:56:41 user nova-compute[74261]:   <os>
Oct 17 11:56:41 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:56:41 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:56:41 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:56:41 user nova-compute[74261]:   </os>
Oct 17 11:56:41 user nova-compute[74261]:   <features>
Oct 17 11:56:41 user nova-compute[74261]:     <acpi/>
Oct 17 11:56:41 user nova-compute[74261]:     <apic/>
Oct 17 11:56:41 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:56:41 user nova-compute[74261]:   </features>
Oct 17 11:56:41 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:56:41 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:56:41 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:56:41 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:56:41 user nova-compute[74261]:   </clock>
Oct 17 11:56:41 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:56:41 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:56:41 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:56:41 user nova-compute[74261]:   </cpu>
Oct 17 11:56:41 user nova-compute[74261]:   <devices>
Oct 17 11:56:41 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:56:41 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:56:41 user nova-compute[74261]:       <source dev="/dev/sdc"/>
Oct 17 11:56:41 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:56:41 user nova-compute[74261]:       <serial>a9822d0e-a521-405d-9f3f-82ea5a209ca9</serial>
Oct 17 11:56:41 user nova-compute[74261]:     </disk>
Oct 17 11:56:41 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:56:41 user nova-compute[74261]:       <mac address="fa:16:3e:5c:94:c7"/>
Oct 17 11:56:41 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:56:41 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:56:41 user nova-compute[74261]:       <target dev="tap51ae7fa5-01"/>
Oct 17 11:56:41 user nova-compute[74261]:     </interface>
Oct 17 11:56:41 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:56:41 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/33e3905d-6e09-4b49-b1fe-deff0d677b1e/console.log" append="off"/>
Oct 17 11:56:41 user nova-compute[74261]:     </serial>
Oct 17 11:56:41 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:56:41 user nova-compute[74261]:     <video>
Oct 17 11:56:41 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:56:41 user nova-compute[74261]:     </video>
Oct 17 11:56:41 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:56:41 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:56:41 user nova-compute[74261]:     </rng>
Oct 17 11:56:41 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:56:41 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:56:41 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:56:41 user nova-compute[74261]:     </memballoon>
Oct 17 11:56:41 user nova-compute[74261]:   </devices>
Oct 17 11:56:41 user nova-compute[74261]: </domain>
Oct 17 11:56:41 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-101703142',display_name='tempest-ServerActionsTestOtherA-server-101703142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-101703142',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-4d8tromd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=33e3905d-6e09-4b49-b1fe-deff0d677b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG os_vif [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '126ceba3-cef2-5c9e-879a-31d1d7b17566', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ae7fa5-01, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ae7fa5-01, col_values=(('qos', UUID('4f1d110f-6481-4722-a98c-bfd4c7680170')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ae7fa5-01, col_values=(('external_ids', {'iface-id': '51ae7fa5-0161-409c-b261-552e0fc76030', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:94:c7', 'vm-uuid': '33e3905d-6e09-4b49-b1fe-deff0d677b1e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:41 user nova-compute[74261]: INFO os_vif [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01')
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:56:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No VIF found with MAC fa:16:3e:5c:94:c7, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-17df451f-03e4-473f-96d9-f3e24ffbde6c req-2f0d9bef-7133-491b-86c5-e6b978698550 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17df451f-03e4-473f-96d9-f3e24ffbde6c req-2f0d9bef-7133-491b-86c5-e6b978698550 service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17df451f-03e4-473f-96d9-f3e24ffbde6c req-2f0d9bef-7133-491b-86c5-e6b978698550 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-17df451f-03e4-473f-96d9-f3e24ffbde6c req-2f0d9bef-7133-491b-86c5-e6b978698550 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-17df451f-03e4-473f-96d9-f3e24ffbde6c req-2f0d9bef-7133-491b-86c5-e6b978698550 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:56:43 user nova-compute[74261]: WARNING nova.compute.manager [req-17df451f-03e4-473f-96d9-f3e24ffbde6c req-2f0d9bef-7133-491b-86c5-e6b978698550 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state building and task_state spawning.
Oct 17 11:56:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-e6904e34-b83d-4923-98a9-f77471556ff1 req-02c85c2e-deca-4369-89eb-6553f50c67fb service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e6904e34-b83d-4923-98a9-f77471556ff1 req-02c85c2e-deca-4369-89eb-6553f50c67fb service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e6904e34-b83d-4923-98a9-f77471556ff1 req-02c85c2e-deca-4369-89eb-6553f50c67fb service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e6904e34-b83d-4923-98a9-f77471556ff1 req-02c85c2e-deca-4369-89eb-6553f50c67fb service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-e6904e34-b83d-4923-98a9-f77471556ff1 req-02c85c2e-deca-4369-89eb-6553f50c67fb service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:56:45 user nova-compute[74261]: WARNING nova.compute.manager [req-e6904e34-b83d-4923-98a9-f77471556ff1 req-02c85c2e-deca-4369-89eb-6553f50c67fb service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state building and task_state spawning.
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:56:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance spawned successfully.
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:56:45 user nova-compute[74261]: INFO nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 17 11:56:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:56:45 user nova-compute[74261]: INFO nova.compute.manager [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Took 25.61 seconds to build instance.
Oct 17 11:56:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-224badc0-536f-4b0c-bb1d-a29baaff25a6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.713s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:56:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-changed-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Refreshing instance network info cache due to event network-changed-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] Acquiring lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] Acquired lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Refreshing network info cache for port 514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updated VIF entry in instance network info cache for port 514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG nova.network.neutron [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updating instance_info_cache with network_info: [{"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:56:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-19a477b6-d108-4553-b271-e101f685f29b req-883a12a7-0ee2-4bf6-ab4f-3bbe4812fe15 service nova] Releasing lock "refresh_cache-d2a99562-808c-4d4a-bc06-ab50f7fa3972" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:56:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'pci_requests' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'numa_topology' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:01 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:57:01 user nova-compute[74261]: INFO nova.compute.claims [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Claim successful on node user
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid d2a99562-808c-4d4a-bc06-ab50f7fa3972 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:02 user nova-compute[74261]: INFO nova.compute.manager [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Attaching volume c14b2cac-e9fa-4359-ba52-c82f4af310b6 to /dev/vdb
Oct 17 11:57:02 user nova-compute[74261]: INFO nova.network.neutron [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG os_brick.utils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14bf2c0-c7c6-4ba8-93b6-5e4720e7f640]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59404026-541f-48ea-b809-f15950f06729]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a9c617-c4b3-4d91-90a1-9835d1f6a71a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb20cf-fd8c-4111-a7dd-89faa930558b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:57:02 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:57:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fbd9f9-adbc-4f80-ad0a-453a83b750c5]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG os_brick.utils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:02 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updating existing volume attachment record: 64ce3c05-2273-421d-b0fb-87a2ea870196 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing instance network info cache due to event network-changed-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] Acquiring lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:57:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Creating image(s)
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'trusted_certs' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] Acquired lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Refreshing network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG nova.objects.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<527e094a-0c2f-4867-bc71-29b05f4812da> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "ffa8d256515a8a56eaf5b427a22a21372737a975" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "ffa8d256515a8a56eaf5b427a22a21372737a975" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG nova.virt.images [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] 280341f5-7801-4ef6-99f3-07b10fe1f586 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.part /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updated VIF entry in instance network info cache for port 9ef1b19a-36ae-4c27-af51-de9dcf45f4ad. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d468bc34-ab90-4418-a3eb-686bb44f5fd2 req-4f1372c3-4252-4420-aa24-2aa3d22322e8 service nova] Releasing lock "refresh_cache-527e094a-0c2f-4867-bc71-29b05f4812da" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.part /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.converted" returned: 0 in 0.307s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "ffa8d256515a8a56eaf5b427a22a21372737a975" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.884s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 --force-share --output=json" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "ffa8d256515a8a56eaf5b427a22a21372737a975" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "ffa8d256515a8a56eaf5b427a22a21372737a975" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975,backing_fmt=raw /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975,backing_fmt=raw /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk 1073741824" returned: 0 in 0.056s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "ffa8d256515a8a56eaf5b427a22a21372737a975" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 --force-share --output=json" returned: 0 in 0.249s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'migration_context' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG nova.objects.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<527e094a-0c2f-4867-bc71-29b05f4812da> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:57:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Rebasing disk image.
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.246s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c -F raw /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:57:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json" returned: 0 in 0.397s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e/disk.rescue --force-share --output=json" returned: 0 in 0.307s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c -F raw /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk" returned: 0 in 3.492s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Ensure instance console log exists: /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Start _get_guest_xml network_info=[{"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c764747aff1e6406c1e54a8a0e1a8ae7',container_format='bare',created_at=2023-10-17T11:54:48Z,direct_url=<?>,disk_format='qcow2',id=280341f5-7801-4ef6-99f3-07b10fe1f586,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-51782779-shelved',owner='117fbb67e9764c1e9e3211ba9a08b864',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '9bd955fe-ea76-4365-9223-398a49ab445e', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIKjCEHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '527e094a-0c2f-4867-bc71-29b05f4812da', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9803343-52c2-4a6c-966e-54f186769d20', 'serial': 'f9803343-52c2-4a6c-966e-54f186769d20'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:57:10 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:57:10 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c764747aff1e6406c1e54a8a0e1a8ae7',container_format='bare',created_at=2023-10-17T11:54:48Z,direct_url=<?>,disk_format='qcow2',id=280341f5-7801-4ef6-99f3-07b10fe1f586,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-51782779-shelved',owner='117fbb67e9764c1e9e3211ba9a08b864',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'vcpu_model' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.objects.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<527e094a-0c2f-4867-bc71-29b05f4812da> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIKjCEHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:10 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:10 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:10 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb1f45-ec03-41c9-b8ea-dccdebcd0135]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:57:10 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfce854-4e47-4bcc-958c-f08b8c8295e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20] added
Oct 17 11:57:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff46cfa-9e68-40ff-8447-7ac27ae947c0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.094s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[68564370-a6d7-4f8c-a855-a54e1329a999]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIKjCEHk {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIKjCEHk" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7b9df1-65e2-45ed-9a3a-9b1fb531d44c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FIKjCEHk'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a83fd-e231-451d-a80a-f42ab8f2f89e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d3b32-712b-4073-a528-76bb68e680de]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceae7d2-3acb-4000-8c30-d417e9df0ee3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260]
Oct 17 11:57:10 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260] successful.
Oct 17 11:57:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2849cd-4b81-47b3-8157-a784b32cbbce]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d33c92a-aa15-449d-9938-cf0ad6dc784c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[245886bd-9c7c-42c3-93ca-5ab365a8ea1f]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIKjCEHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '26165383238353432', 'path': '/dev/sdd'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165383238353432', 'path': '/dev/sdd'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-51782779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-51782779',id=24,image_ref='280341f5-7801-4ef6-99f3-07b10fe1f586',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1685563374',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-vlytl2r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member',shelved_at='2023-10-17T11:54:52.401311',shelved_host='user',shelved_image_id='280341f5-7801-4ef6-99f3-07b10fe1f586'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:56:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=527e094a-0c2f-4867-bc71-29b05f4812da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'pci_devices' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.objects.base [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<527e094a-0c2f-4867-bc71-29b05f4812da> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:57:11 user nova-compute[74261]:   <uuid>527e094a-0c2f-4867-bc71-29b05f4812da</uuid>
Oct 17 11:57:11 user nova-compute[74261]:   <name>instance-00000018</name>
Oct 17 11:57:11 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:57:11 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:57:11 user nova-compute[74261]:   <metadata>
Oct 17 11:57:11 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:57:11 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:57:11 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-51782779</nova:name>
Oct 17 11:57:11 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:57:10</nova:creationTime>
Oct 17 11:57:11 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:57:11 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:57:11 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:57:11 user nova-compute[74261]:       <nova:owner>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:user uuid="229ff57765914e75a370db408f67c501">tempest-AttachVolumeShelveTestJSON-63868510-project-member</nova:user>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:project uuid="117fbb67e9764c1e9e3211ba9a08b864">tempest-AttachVolumeShelveTestJSON-63868510</nova:project>
Oct 17 11:57:11 user nova-compute[74261]:       </nova:owner>
Oct 17 11:57:11 user nova-compute[74261]:       <nova:root type="image" uuid="280341f5-7801-4ef6-99f3-07b10fe1f586"/>
Oct 17 11:57:11 user nova-compute[74261]:       <nova:ports>
Oct 17 11:57:11 user nova-compute[74261]:         <nova:port uuid="9ef1b19a-36ae-4c27-af51-de9dcf45f4ad">
Oct 17 11:57:11 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 11:57:11 user nova-compute[74261]:         </nova:port>
Oct 17 11:57:11 user nova-compute[74261]:       </nova:ports>
Oct 17 11:57:11 user nova-compute[74261]:     </nova:instance>
Oct 17 11:57:11 user nova-compute[74261]:   </metadata>
Oct 17 11:57:11 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:57:11 user nova-compute[74261]:     <system>
Oct 17 11:57:11 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:57:11 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:57:11 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:57:11 user nova-compute[74261]:       <entry name="serial">527e094a-0c2f-4867-bc71-29b05f4812da</entry>
Oct 17 11:57:11 user nova-compute[74261]:       <entry name="uuid">527e094a-0c2f-4867-bc71-29b05f4812da</entry>
Oct 17 11:57:11 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:57:11 user nova-compute[74261]:     </system>
Oct 17 11:57:11 user nova-compute[74261]:   </sysinfo>
Oct 17 11:57:11 user nova-compute[74261]:   <os>
Oct 17 11:57:11 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:57:11 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:57:11 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:57:11 user nova-compute[74261]:   </os>
Oct 17 11:57:11 user nova-compute[74261]:   <features>
Oct 17 11:57:11 user nova-compute[74261]:     <acpi/>
Oct 17 11:57:11 user nova-compute[74261]:     <apic/>
Oct 17 11:57:11 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:57:11 user nova-compute[74261]:   </features>
Oct 17 11:57:11 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:57:11 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:57:11 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:57:11 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:57:11 user nova-compute[74261]:   </clock>
Oct 17 11:57:11 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:57:11 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:57:11 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:57:11 user nova-compute[74261]:   </cpu>
Oct 17 11:57:11 user nova-compute[74261]:   <devices>
Oct 17 11:57:11 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:57:11 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:57:11 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk"/>
Oct 17 11:57:11 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:57:11 user nova-compute[74261]:     </disk>
Oct 17 11:57:11 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:57:11 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:57:11 user nova-compute[74261]:       <source dev="/dev/sdd"/>
Oct 17 11:57:11 user nova-compute[74261]:       <target dev="vdc" bus="virtio"/>
Oct 17 11:57:11 user nova-compute[74261]:       <serial>f9803343-52c2-4a6c-966e-54f186769d20</serial>
Oct 17 11:57:11 user nova-compute[74261]:     </disk>
Oct 17 11:57:11 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:57:11 user nova-compute[74261]:       <mac address="fa:16:3e:b9:91:f6"/>
Oct 17 11:57:11 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:57:11 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:57:11 user nova-compute[74261]:       <target dev="tap9ef1b19a-36"/>
Oct 17 11:57:11 user nova-compute[74261]:     </interface>
Oct 17 11:57:11 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:57:11 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/console.log" append="off"/>
Oct 17 11:57:11 user nova-compute[74261]:     </serial>
Oct 17 11:57:11 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:57:11 user nova-compute[74261]:     <video>
Oct 17 11:57:11 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:57:11 user nova-compute[74261]:     </video>
Oct 17 11:57:11 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:57:11 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:57:11 user nova-compute[74261]:     </rng>
Oct 17 11:57:11 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:57:11 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:57:11 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:57:11 user nova-compute[74261]:     </memballoon>
Oct 17 11:57:11 user nova-compute[74261]:   </devices>
Oct 17 11:57:11 user nova-compute[74261]: </domain>
Oct 17 11:57:11 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-51782779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-51782779',id=24,image_ref='280341f5-7801-4ef6-99f3-07b10fe1f586',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1685563374',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-vlytl2r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member',shelved_at='2023-10-17T11:54:52.401311',shelved_host='user',shelved_image_id='280341f5-7801-4ef6-99f3-07b10fe1f586'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:56:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=527e094a-0c2f-4867-bc71-29b05f4812da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG os_vif [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9aa11dd-a6ef-555b-860d-e601c038646d', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ef1b19a-36, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ef1b19a-36, col_values=(('qos', UUID('05818838-cf74-47b2-82e2-9f1d80ad9fe9')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ef1b19a-36, col_values=(('external_ids', {'iface-id': '9ef1b19a-36ae-4c27-af51-de9dcf45f4ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:91:f6', 'vm-uuid': '527e094a-0c2f-4867-bc71-29b05f4812da'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:12 user nova-compute[74261]: INFO os_vif [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36')
Oct 17 11:57:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No VIF found with MAC fa:16:3e:b9:91:f6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-f769bfac-5e28-4614-924f-de2ca33a646d req-40d0880e-a988-4a1e-ac3d-6f90adea8265 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f769bfac-5e28-4614-924f-de2ca33a646d req-40d0880e-a988-4a1e-ac3d-6f90adea8265 service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f769bfac-5e28-4614-924f-de2ca33a646d req-40d0880e-a988-4a1e-ac3d-6f90adea8265 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f769bfac-5e28-4614-924f-de2ca33a646d req-40d0880e-a988-4a1e-ac3d-6f90adea8265 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-f769bfac-5e28-4614-924f-de2ca33a646d req-40d0880e-a988-4a1e-ac3d-6f90adea8265 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:16 user nova-compute[74261]: WARNING nova.compute.manager [req-f769bfac-5e28-4614-924f-de2ca33a646d req-40d0880e-a988-4a1e-ac3d-6f90adea8265 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-9fc63bdc-5b71-4e03-b1b2-15c861fc9e3d req-0e69e15d-9502-4dd6-9291-baa9831cf2a5 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fc63bdc-5b71-4e03-b1b2-15c861fc9e3d req-0e69e15d-9502-4dd6-9291-baa9831cf2a5 service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fc63bdc-5b71-4e03-b1b2-15c861fc9e3d req-0e69e15d-9502-4dd6-9291-baa9831cf2a5 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fc63bdc-5b71-4e03-b1b2-15c861fc9e3d req-0e69e15d-9502-4dd6-9291-baa9831cf2a5 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-9fc63bdc-5b71-4e03-b1b2-15c861fc9e3d req-0e69e15d-9502-4dd6-9291-baa9831cf2a5 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:16 user nova-compute[74261]: WARNING nova.compute.manager [req-9fc63bdc-5b71-4e03-b1b2-15c861fc9e3d req-0e69e15d-9502-4dd6-9291-baa9831cf2a5 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:57:16 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:57:16 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=25.092987060546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance spawned successfully.
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d51b7aad-e6a4-40b3-931d-8430348db4c8): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13a48798-5a0f-49a3-a317-39ce03a2eaef tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.141s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:16 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:57:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:17 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:57:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:57:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:17 user nova-compute[74261]: INFO nova.compute.manager [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Unrescuing
Oct 17 11:57:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:57:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:57:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'flavor' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-887380b4-6905-462e-8b2c-0fedf7db3c45 req-39890568-9882-471f-ac69-3a51727f5764 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-887380b4-6905-462e-8b2c-0fedf7db3c45 req-39890568-9882-471f-ac69-3a51727f5764 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-887380b4-6905-462e-8b2c-0fedf7db3c45 req-39890568-9882-471f-ac69-3a51727f5764 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-887380b4-6905-462e-8b2c-0fedf7db3c45 req-39890568-9882-471f-ac69-3a51727f5764 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG nova.compute.manager [req-887380b4-6905-462e-8b2c-0fedf7db3c45 req-39890568-9882-471f-ac69-3a51727f5764 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:18 user nova-compute[74261]: WARNING nova.compute.manager [req-887380b4-6905-462e-8b2c-0fedf7db3c45 req-39890568-9882-471f-ac69-3a51727f5764 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:57:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance destroyed successfully.
Oct 17 11:57:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-52244a99-22ca-4739-87bb-60f722eb1733 req-6eb1ebf5-a2e6-4c36-ac71-b33ca3d5de63 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52244a99-22ca-4739-87bb-60f722eb1733 req-6eb1ebf5-a2e6-4c36-ac71-b33ca3d5de63 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52244a99-22ca-4739-87bb-60f722eb1733 req-6eb1ebf5-a2e6-4c36-ac71-b33ca3d5de63 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52244a99-22ca-4739-87bb-60f722eb1733 req-6eb1ebf5-a2e6-4c36-ac71-b33ca3d5de63 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-52244a99-22ca-4739-87bb-60f722eb1733 req-6eb1ebf5-a2e6-4c36-ac71-b33ca3d5de63 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:20 user nova-compute[74261]: WARNING nova.compute.manager [req-52244a99-22ca-4739-87bb-60f722eb1733 req-6eb1ebf5-a2e6-4c36-ac71-b33ca3d5de63 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:57:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:22 user nova-compute[74261]: WARNING nova.compute.manager [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:57:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:22 user nova-compute[74261]: WARNING nova.compute.manager [req-a41ed4d9-6dbf-42fd-b410-6497def4fc51 req-c875650e-47ea-41fe-a87d-e36087c33653 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state rescued and task_state unrescuing.
Oct 17 11:57:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0caa9e5f-f082-4457-aa7b-af4d08ebaecd tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:57:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdnuBYCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:23 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:23 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:23 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd670e7-7ff4-4a31-94c7-473125e0e468]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:57:23 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66392d1-2d3b-4b09-bac5-b253f4495a9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6] added
Oct 17 11:57:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfa86d9-1260-40c6-8b75-f58b51363c38]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829a86a-9ec4-4651-93fb-e63d408c03f6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kdnuBYCi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kdnuBYCi" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03568c2-39dc-4d4a-8b80-23a290c63639]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kdnuBYCi'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7916c4cf-a5d7-489c-835f-e16b78ec08b5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e786cfef-b23c-4e39-a948-818149742bf0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a85746-d038-4058-bb17-d91cc0bf8a7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260]
Oct 17 11:57:23 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260] successful.
Oct 17 11:57:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[16025ee5-dd0f-4e18-8890-c0a4e42f2385]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4abb2-e9c0-4755-8f04-643ba8a91927]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 (non-flash)
Oct 17 11:57:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.050s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfb085e-40a7-4207-a7c8-328c68f36379]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:57:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdnuBYCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:57:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26433383336646433', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433383336646433', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:57:24 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid d2a99562-808c-4d4a-bc06-ab50f7fa3972 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:57:24 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:57:24 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:57:24 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:57:24 user nova-compute[74261]:   <serial>c14b2cac-e9fa-4359-ba52-c82f4af310b6</serial>
Oct 17 11:57:24 user nova-compute[74261]: </disk>
Oct 17 11:57:24 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:57:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:a3:73:4f, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:57:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d224c85b-6124-4a21-937e-1b27355dffd0 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.733s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:25 user nova-compute[74261]: INFO nova.compute.manager [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Detaching volume c14b2cac-e9fa-4359-ba52-c82f4af310b6
Oct 17 11:57:26 user nova-compute[74261]: INFO nova.virt.block_device [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Attempting to driver detach volume c14b2cac-e9fa-4359-ba52-c82f4af310b6 from mountpoint /dev/vdb
Oct 17 11:57:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Attempting to detach device vdb from instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:57:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:57:26 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:57:26 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:57:26 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:57:26 user nova-compute[74261]:   <serial>c14b2cac-e9fa-4359-ba52-c82f4af310b6</serial>
Oct 17 11:57:26 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:57:26 user nova-compute[74261]: </disk>
Oct 17 11:57:26 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:57:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully detached device vdb from instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 from the persistent domain config.
Oct 17 11:57:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:57:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:57:26 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:57:26 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:57:26 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:57:26 user nova-compute[74261]:   <serial>c14b2cac-e9fa-4359-ba52-c82f4af310b6</serial>
Oct 17 11:57:26 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:57:26 user nova-compute[74261]: </disk>
Oct 17 11:57:26 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:57:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:57:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-changed-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Refreshing instance network info cache due to event network-changed-c974e6b3-e867-4d94-afde-4d8599a853c2. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] Acquiring lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] Acquired lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG nova.network.neutron [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Refreshing network info cache for port c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG nova.network.neutron [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updated VIF entry in instance network info cache for port c974e6b3-e867-4d94-afde-4d8599a853c2. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG nova.network.neutron [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updating instance_info_cache with network_info: [{"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:57:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-3e2ae15d-caf0-4a27-b573-f743efdefc03 req-29cc1038-a316-42c8-803b-3ca0e5dc4523 service nova] Releasing lock "refresh_cache-c60a7acc-a630-4f9f-98ca-8bea9467cc9e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:57:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:37 user nova-compute[74261]: INFO nova.compute.manager [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attaching volume afe2e8ce-13bb-4748-8b9d-9794797a6164 to /dev/vdb
Oct 17 11:57:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a09b5b-f412-4931-8b57-c5355f29b4d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca9bba0-2233-43ce-b5e7-2263939e041d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820cc47-7dd5-45ea-9d99-85f459abd7a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d86800e-1073-40b1-a3cd-7e071162af5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:57:37 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:57:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9700e41-23b8-46e1-b1e6-96997aa27056]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG os_brick.utils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:37 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updating existing volume attachment record: 9bdea31d-bc7e-4d1c-9b8c-c5efa7422003 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:57:39 user nova-compute[74261]: INFO nova.compute.claims [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Claim successful on node user
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:57:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.policy [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '171d1037b5b74e09812373e40ef7c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0a71e6e0274702b67351ba09b91c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:57:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Creating image(s)
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk 1073741824" returned: 0 in 0.054s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.227s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG nova.network.neutron [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Successfully created port: fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Cannot resize image /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Ensure instance console log exists: /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Successfully updated port: fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing instance network info cache due to event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:57:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance network_info: |[{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Start _get_guest_xml network_info=[{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:57:42 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:57:42 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201570900',display_name='tempest-ServerRescueNegativeTestJSON-server-201570900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201570900',id=30,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeF/gSwlEeNPSISacTsorapNh7IBA53uRWQXmuM8RSeXmFBBNdMTfcNvMadaDVtgHyJRc9aqFfmXE20arIfd3+LiOx5t16Dmt8WpcMToXi6VKDz/d0ofOb8DeFuyL4LsA==',key_name='tempest-keypair-1480772815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-nrri5545',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171d1037b5b74e09812373e40ef7c193',uuid=f9098343-8120-48b2-848b-2807bb60eb73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'pci_devices' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:57:42 user nova-compute[74261]:   <uuid>f9098343-8120-48b2-848b-2807bb60eb73</uuid>
Oct 17 11:57:42 user nova-compute[74261]:   <name>instance-0000001e</name>
Oct 17 11:57:42 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:57:42 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:57:42 user nova-compute[74261]:   <metadata>
Oct 17 11:57:42 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:57:42 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:57:42 user nova-compute[74261]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-201570900</nova:name>
Oct 17 11:57:42 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:57:42</nova:creationTime>
Oct 17 11:57:42 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:57:42 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:57:42 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:57:42 user nova-compute[74261]:       <nova:owner>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:user uuid="171d1037b5b74e09812373e40ef7c193">tempest-ServerRescueNegativeTestJSON-1673978463-project-member</nova:user>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:project uuid="ed0a71e6e0274702b67351ba09b91c7f">tempest-ServerRescueNegativeTestJSON-1673978463</nova:project>
Oct 17 11:57:42 user nova-compute[74261]:       </nova:owner>
Oct 17 11:57:42 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:57:42 user nova-compute[74261]:       <nova:ports>
Oct 17 11:57:42 user nova-compute[74261]:         <nova:port uuid="fed586ab-a4b9-4c76-8dae-1859edf00501">
Oct 17 11:57:42 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 11:57:42 user nova-compute[74261]:         </nova:port>
Oct 17 11:57:42 user nova-compute[74261]:       </nova:ports>
Oct 17 11:57:42 user nova-compute[74261]:     </nova:instance>
Oct 17 11:57:42 user nova-compute[74261]:   </metadata>
Oct 17 11:57:42 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:57:42 user nova-compute[74261]:     <system>
Oct 17 11:57:42 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:57:42 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:57:42 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:57:42 user nova-compute[74261]:       <entry name="serial">f9098343-8120-48b2-848b-2807bb60eb73</entry>
Oct 17 11:57:42 user nova-compute[74261]:       <entry name="uuid">f9098343-8120-48b2-848b-2807bb60eb73</entry>
Oct 17 11:57:42 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:57:42 user nova-compute[74261]:     </system>
Oct 17 11:57:42 user nova-compute[74261]:   </sysinfo>
Oct 17 11:57:42 user nova-compute[74261]:   <os>
Oct 17 11:57:42 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:57:42 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:57:42 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:57:42 user nova-compute[74261]:   </os>
Oct 17 11:57:42 user nova-compute[74261]:   <features>
Oct 17 11:57:42 user nova-compute[74261]:     <acpi/>
Oct 17 11:57:42 user nova-compute[74261]:     <apic/>
Oct 17 11:57:42 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:57:42 user nova-compute[74261]:   </features>
Oct 17 11:57:42 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:57:42 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:57:42 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:57:42 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:57:42 user nova-compute[74261]:   </clock>
Oct 17 11:57:42 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:57:42 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:57:42 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:57:42 user nova-compute[74261]:   </cpu>
Oct 17 11:57:42 user nova-compute[74261]:   <devices>
Oct 17 11:57:42 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:57:42 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:57:42 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk"/>
Oct 17 11:57:42 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:57:42 user nova-compute[74261]:     </disk>
Oct 17 11:57:42 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:57:42 user nova-compute[74261]:       <mac address="fa:16:3e:1b:70:17"/>
Oct 17 11:57:42 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:57:42 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:57:42 user nova-compute[74261]:       <target dev="tapfed586ab-a4"/>
Oct 17 11:57:42 user nova-compute[74261]:     </interface>
Oct 17 11:57:42 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:57:42 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/console.log" append="off"/>
Oct 17 11:57:42 user nova-compute[74261]:     </serial>
Oct 17 11:57:42 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:57:42 user nova-compute[74261]:     <video>
Oct 17 11:57:42 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:57:42 user nova-compute[74261]:     </video>
Oct 17 11:57:42 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:57:42 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:57:42 user nova-compute[74261]:     </rng>
Oct 17 11:57:42 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:57:42 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:57:42 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:57:42 user nova-compute[74261]:     </memballoon>
Oct 17 11:57:42 user nova-compute[74261]:   </devices>
Oct 17 11:57:42 user nova-compute[74261]: </domain>
Oct 17 11:57:42 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201570900',display_name='tempest-ServerRescueNegativeTestJSON-server-201570900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201570900',id=30,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeF/gSwlEeNPSISacTsorapNh7IBA53uRWQXmuM8RSeXmFBBNdMTfcNvMadaDVtgHyJRc9aqFfmXE20arIfd3+LiOx5t16Dmt8WpcMToXi6VKDz/d0ofOb8DeFuyL4LsA==',key_name='tempest-keypair-1480772815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-nrri5545',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171d1037b5b74e09812373e40ef7c193',uuid=f9098343-8120-48b2-848b-2807bb60eb73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG os_vif [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed86ac04-6ee3-528e-a0c2-88e5fb01aba9', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfed586ab-a4, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfed586ab-a4, col_values=(('qos', UUID('88c678e4-b554-47b8-b4ed-03cfd430efce')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfed586ab-a4, col_values=(('external_ids', {'iface-id': 'fed586ab-a4b9-4c76-8dae-1859edf00501', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:70:17', 'vm-uuid': 'f9098343-8120-48b2-848b-2807bb60eb73'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:42 user nova-compute[74261]: INFO os_vif [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4')
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:1b:70:17, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:57:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updated VIF entry in instance network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:57:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:57:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-73fc82ca-1a48-4296-bf42-613e61bc4ffa req-b803a735-2251-4871-8b16-e8081f01d2d8 service nova] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:57:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-50528b42-a2df-4b12-96f7-80ddda28e7a2 req-ec86a047-f3a1-4280-865c-6c2456b09034 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-50528b42-a2df-4b12-96f7-80ddda28e7a2 req-ec86a047-f3a1-4280-865c-6c2456b09034 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-50528b42-a2df-4b12-96f7-80ddda28e7a2 req-ec86a047-f3a1-4280-865c-6c2456b09034 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-50528b42-a2df-4b12-96f7-80ddda28e7a2 req-ec86a047-f3a1-4280-865c-6c2456b09034 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-50528b42-a2df-4b12-96f7-80ddda28e7a2 req-ec86a047-f3a1-4280-865c-6c2456b09034 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:44 user nova-compute[74261]: WARNING nova.compute.manager [req-50528b42-a2df-4b12-96f7-80ddda28e7a2 req-ec86a047-f3a1-4280-865c-6c2456b09034 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state building and task_state spawning.
Oct 17 11:57:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-9f327f4e-8b5a-4753-99a1-d88644e6a113 req-8077b5b2-f7a6-41da-97f7-cd3b2fbaf032 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9f327f4e-8b5a-4753-99a1-d88644e6a113 req-8077b5b2-f7a6-41da-97f7-cd3b2fbaf032 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9f327f4e-8b5a-4753-99a1-d88644e6a113 req-8077b5b2-f7a6-41da-97f7-cd3b2fbaf032 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9f327f4e-8b5a-4753-99a1-d88644e6a113 req-8077b5b2-f7a6-41da-97f7-cd3b2fbaf032 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-9f327f4e-8b5a-4753-99a1-d88644e6a113 req-8077b5b2-f7a6-41da-97f7-cd3b2fbaf032 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:57:46 user nova-compute[74261]: WARNING nova.compute.manager [req-9f327f4e-8b5a-4753-99a1-d88644e6a113 req-8077b5b2-f7a6-41da-97f7-cd3b2fbaf032 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state building and task_state spawning.
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:57:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance spawned successfully.
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:57:46 user nova-compute[74261]: INFO nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Took 6.50 seconds to spawn the instance on the hypervisor.
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:57:46 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 is timed out.
Oct 17 11:57:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully detached device vdb from instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 from the live domain config.
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdnuBYCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:46 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: INFO nova.compute.manager [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Took 7.48 seconds to build instance.
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f621aae1-0b1b-43ce-8a76-444dfa1dd7e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:57:46 user nova-compute[74261]: No targets found.
Oct 17 11:57:46 user nova-compute[74261]: iSNS:
Oct 17 11:57:46 user nova-compute[74261]: No targets found.
Oct 17 11:57:46 user nova-compute[74261]: STATIC:
Oct 17 11:57:46 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 11:57:46 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:57:46 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:57:46 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6
Oct 17 11:57:46 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:57:46 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:57:46 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:57:46 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:57:46 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:57:46 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20
Oct 17 11:57:46 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:57:46 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:57:46 user nova-compute[74261]: FIRMWARE:
Oct 17 11:57:46 user nova-compute[74261]: No targets found.
Oct 17 11:57:46 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:57:46 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:57:46 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-507887b8-22dd-4867-90c6-01f54af22cfe tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.607s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52d538-0b59-41cf-8270-c43b768094bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5528a1-82b1-42cf-8d40-c6a033efe1db]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 (non-flash)
Oct 17 11:57:46 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24393130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6'): ({'sde'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Removing single pathed devices sde {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6d4043-2616-44d4-aaf4-f990f6fae700]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b78b5ec-60e3-4cd5-be6a-b245e87b6956]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flushing IO for device /dev/sde {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c376ff-fe0d-4d3c-aed8-431727afae10]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0f3e3-c0fd-4ad9-85b0-d3cc8904a8a1]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf0008-ec37-41d3-bbc9-d73c5aaed391]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa450a91-79ca-435e-ab8f-aaba591bf742]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260]
Oct 17 11:57:46 user nova-compute[74261]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6, portal: 172.16.0.220,3260] successful.
Oct 17 11:57:46 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c14b2cac-e9fa-4359-ba52-c82f4af310b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be3be3-3ae6-40fa-a29a-9070f490cad6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== disconnect_volume: return (387ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid d2a99562-808c-4d4a-bc06-ab50f7fa3972 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'flavor' on Instance uuid 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d3d0bc9b-a22e-480a-ac63-224239fa36c4 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.032s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:57:48 user nova-compute[74261]: INFO nova.compute.manager [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Attaching volume 838adc28-bd04-4537-b244-ca94b926950f to /dev/vdb
Oct 17 11:57:48 user nova-compute[74261]: DEBUG os_brick.utils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[713057e3-66e3-454a-b061-0d99d982148b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb47208-5db1-4ca3-9c95-f57272bcfd2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f88d04-9491-419c-a800-8a4326689b91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf9df4-d144-4d5f-9f2d-288ec4245576]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:57:48 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:57:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2dfa77-cc25-41a6-80f9-59e48c8a0fc4]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG os_brick.utils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:48 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating existing volume attachment record: 0cf1adb0-3806-4139-a328-04bf712c2873 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:57:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEwcrUWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:57:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:57:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:57:57 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:57:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ebb701-2781-4311-a3e9-71c819a35179]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:57:57 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7947da6b-eb89-4de8-aa72-4679fce27511]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164] added
Oct 17 11:57:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b78e80f-5889-4d20-8467-519b55e46f8a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb543b27-b9e3-4835-8251-07efcf3a464a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEwcrUWk {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEwcrUWk" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefdf6a-cf5e-44dd-bbd2-0921c2f5339f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nEwcrUWk'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e768175-ce0e-42b4-a015-421dc042f974]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa5b089-6877-4a52-8300-0c77d49cb3c2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54cf4be-62be-4d28-87f2-f2c283a5330e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260]
Oct 17 11:57:58 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260] successful.
Oct 17 11:57:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7c80b3-789a-4355-8013-c9a306b01e22]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a62dfe-a5fc-40d6-a917-4b6875e57634]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:57:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1533b7fb-c90c-4dd1-8691-cea907c2aa61]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:57:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEwcrUWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26263383638363838', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263383638363838', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:57:59 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:57:59 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:57:59 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:57:59 user nova-compute[74261]:   <serial>afe2e8ce-13bb-4748-8b9d-9794797a6164</serial>
Oct 17 11:57:59 user nova-compute[74261]: </disk>
Oct 17 11:57:59 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No VIF found with MAC fa:16:3e:b5:b4:71, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:57:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d2fbb925-6f23-4e62-8e33-e0b671271900 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.456s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:58:02 user nova-compute[74261]: INFO nova.compute.claims [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Claim successful on node user
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:58:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:58:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Creating image(s)
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "/opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "/opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "/opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG nova.policy [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac64c9814bbf479fab67d3f8ae5bbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d7389b272747cd9061bf4394d65701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.270s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk 1073741824" returned: 0 in 0.055s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.265s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Cannot resize image /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Ensure instance console log exists: /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Successfully created port: 862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Successfully updated port: 862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "refresh_cache-35114c87-8d9d-4156-8b9a-2b541e57fb9f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquired lock "refresh_cache-35114c87-8d9d-4156-8b9a-2b541e57fb9f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-changed-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Refreshing instance network info cache due to event network-changed-862500bc-8fff-4311-994e-5517783fe5c2. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] Acquiring lock "refresh_cache-35114c87-8d9d-4156-8b9a-2b541e57fb9f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Updating instance_info_cache with network_info: [{"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Releasing lock "refresh_cache-35114c87-8d9d-4156-8b9a-2b541e57fb9f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Instance network_info: |[{"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] Acquired lock "refresh_cache-35114c87-8d9d-4156-8b9a-2b541e57fb9f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Refreshing network info cache for port 862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Start _get_guest_xml network_info=[{"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:58:06 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:58:06 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-650448322',display_name='tempest-VolumesNegativeTest-instance-650448322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-650448322',id=31,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9d7389b272747cd9061bf4394d65701',ramdisk_id='',reservation_id='r-pr3ceb44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1124960665',owner_user_name='tempest-VolumesNegativeTest-1124960665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:58:04Z,user_data=None,user_id='ac64c9814bbf479fab67d3f8ae5bbebb',uuid=35114c87-8d9d-4156-8b9a-2b541e57fb9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Converting VIF {"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lazy-loading 'pci_devices' on Instance uuid 35114c87-8d9d-4156-8b9a-2b541e57fb9f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:58:06 user nova-compute[74261]:   <uuid>35114c87-8d9d-4156-8b9a-2b541e57fb9f</uuid>
Oct 17 11:58:06 user nova-compute[74261]:   <name>instance-0000001f</name>
Oct 17 11:58:06 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:58:06 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:58:06 user nova-compute[74261]:   <metadata>
Oct 17 11:58:06 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:58:06 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:58:06 user nova-compute[74261]:       <nova:name>tempest-VolumesNegativeTest-instance-650448322</nova:name>
Oct 17 11:58:06 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:58:06</nova:creationTime>
Oct 17 11:58:06 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:58:06 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:58:06 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:58:06 user nova-compute[74261]:       <nova:owner>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:user uuid="ac64c9814bbf479fab67d3f8ae5bbebb">tempest-VolumesNegativeTest-1124960665-project-member</nova:user>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:project uuid="f9d7389b272747cd9061bf4394d65701">tempest-VolumesNegativeTest-1124960665</nova:project>
Oct 17 11:58:06 user nova-compute[74261]:       </nova:owner>
Oct 17 11:58:06 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:58:06 user nova-compute[74261]:       <nova:ports>
Oct 17 11:58:06 user nova-compute[74261]:         <nova:port uuid="862500bc-8fff-4311-994e-5517783fe5c2">
Oct 17 11:58:06 user nova-compute[74261]:           <nova:ip type="fixed" address="192.168.233.220" ipVersion="4"/>
Oct 17 11:58:06 user nova-compute[74261]:         </nova:port>
Oct 17 11:58:06 user nova-compute[74261]:       </nova:ports>
Oct 17 11:58:06 user nova-compute[74261]:     </nova:instance>
Oct 17 11:58:06 user nova-compute[74261]:   </metadata>
Oct 17 11:58:06 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:58:06 user nova-compute[74261]:     <system>
Oct 17 11:58:06 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:58:06 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:58:06 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:58:06 user nova-compute[74261]:       <entry name="serial">35114c87-8d9d-4156-8b9a-2b541e57fb9f</entry>
Oct 17 11:58:06 user nova-compute[74261]:       <entry name="uuid">35114c87-8d9d-4156-8b9a-2b541e57fb9f</entry>
Oct 17 11:58:06 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:58:06 user nova-compute[74261]:     </system>
Oct 17 11:58:06 user nova-compute[74261]:   </sysinfo>
Oct 17 11:58:06 user nova-compute[74261]:   <os>
Oct 17 11:58:06 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:58:06 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:58:06 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:58:06 user nova-compute[74261]:   </os>
Oct 17 11:58:06 user nova-compute[74261]:   <features>
Oct 17 11:58:06 user nova-compute[74261]:     <acpi/>
Oct 17 11:58:06 user nova-compute[74261]:     <apic/>
Oct 17 11:58:06 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:58:06 user nova-compute[74261]:   </features>
Oct 17 11:58:06 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:58:06 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:58:06 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:58:06 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:58:06 user nova-compute[74261]:   </clock>
Oct 17 11:58:06 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:58:06 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:58:06 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:58:06 user nova-compute[74261]:   </cpu>
Oct 17 11:58:06 user nova-compute[74261]:   <devices>
Oct 17 11:58:06 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:58:06 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:58:06 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk"/>
Oct 17 11:58:06 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:58:06 user nova-compute[74261]:     </disk>
Oct 17 11:58:06 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:58:06 user nova-compute[74261]:       <mac address="fa:16:3e:7a:c4:33"/>
Oct 17 11:58:06 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:58:06 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:58:06 user nova-compute[74261]:       <target dev="tap862500bc-8f"/>
Oct 17 11:58:06 user nova-compute[74261]:     </interface>
Oct 17 11:58:06 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:58:06 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/console.log" append="off"/>
Oct 17 11:58:06 user nova-compute[74261]:     </serial>
Oct 17 11:58:06 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:58:06 user nova-compute[74261]:     <video>
Oct 17 11:58:06 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:58:06 user nova-compute[74261]:     </video>
Oct 17 11:58:06 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:58:06 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:58:06 user nova-compute[74261]:     </rng>
Oct 17 11:58:06 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:58:06 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:58:06 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:58:06 user nova-compute[74261]:     </memballoon>
Oct 17 11:58:06 user nova-compute[74261]:   </devices>
Oct 17 11:58:06 user nova-compute[74261]: </domain>
Oct 17 11:58:06 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-650448322',display_name='tempest-VolumesNegativeTest-instance-650448322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-650448322',id=31,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9d7389b272747cd9061bf4394d65701',ramdisk_id='',reservation_id='r-pr3ceb44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1124960665',owner_user_name='tempest-VolumesNegativeTest-1124960665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:58:04Z,user_data=None,user_id='ac64c9814bbf479fab67d3f8ae5bbebb',uuid=35114c87-8d9d-4156-8b9a-2b541e57fb9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Converting VIF {"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG os_vif [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16f8dfe9-0909-5a09-b679-3f281116dc1d', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap862500bc-8f, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap862500bc-8f, col_values=(('qos', UUID('0b5faa93-7a67-431b-9c96-8a6f5f49dc4e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap862500bc-8f, col_values=(('external_ids', {'iface-id': '862500bc-8fff-4311-994e-5517783fe5c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:c4:33', 'vm-uuid': '35114c87-8d9d-4156-8b9a-2b541e57fb9f'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:06 user nova-compute[74261]: INFO os_vif [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f')
Oct 17 11:58:06 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] No VIF found with MAC fa:16:3e:7a:c4:33, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Updated VIF entry in instance network info cache for port 862500bc-8fff-4311-994e-5517783fe5c2. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Updating instance_info_cache with network_info: [{"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-261e33cd-614f-4426-a9e4-e657776e2b90 req-997383d0-3355-4602-96a1-8fc5207833d2 service nova] Releasing lock "refresh_cache-35114c87-8d9d-4156-8b9a-2b541e57fb9f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:07 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-fd98e3e7-10ba-499b-aba2-28d55d48de4c req-b048639b-879a-4332-947b-ec8308f95f7e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fd98e3e7-10ba-499b-aba2-28d55d48de4c req-b048639b-879a-4332-947b-ec8308f95f7e service nova] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fd98e3e7-10ba-499b-aba2-28d55d48de4c req-b048639b-879a-4332-947b-ec8308f95f7e service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fd98e3e7-10ba-499b-aba2-28d55d48de4c req-b048639b-879a-4332-947b-ec8308f95f7e service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-fd98e3e7-10ba-499b-aba2-28d55d48de4c req-b048639b-879a-4332-947b-ec8308f95f7e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] No waiting events found dispatching network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:08 user nova-compute[74261]: WARNING nova.compute.manager [req-fd98e3e7-10ba-499b-aba2-28d55d48de4c req-b048639b-879a-4332-947b-ec8308f95f7e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received unexpected event network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 for instance with vm_state building and task_state spawning.
Oct 17 11:58:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTBwkVXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:10 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:10 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:10 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e66c8-f0ba-4b93-831b-30d54a11f8fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:58:10 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1bd211-faa0-4678-b94a-9b3eff9cb69d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f] added
Oct 17 11:58:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.101s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc1bc9-83ee-435d-9f9b-a8f8b96125be]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ceb4e0-a3df-454a-909e-289524e68b5f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-32a782e4-c9bc-468a-9bc2-033fe8885e58 req-f62bccde-4b19-4af9-9c57-64103ca799f3 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-32a782e4-c9bc-468a-9bc2-033fe8885e58 req-f62bccde-4b19-4af9-9c57-64103ca799f3 service nova] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-32a782e4-c9bc-468a-9bc2-033fe8885e58 req-f62bccde-4b19-4af9-9c57-64103ca799f3 service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-32a782e4-c9bc-468a-9bc2-033fe8885e58 req-f62bccde-4b19-4af9-9c57-64103ca799f3 service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-32a782e4-c9bc-468a-9bc2-033fe8885e58 req-f62bccde-4b19-4af9-9c57-64103ca799f3 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] No waiting events found dispatching network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:10 user nova-compute[74261]: WARNING nova.compute.manager [req-32a782e4-c9bc-468a-9bc2-033fe8885e58 req-f62bccde-4b19-4af9-9c57-64103ca799f3 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received unexpected event network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 for instance with vm_state building and task_state spawning.
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTBwkVXD {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTBwkVXD" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1932eb-9553-492b-9440-f53a5d92f855]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTBwkVXD'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47b484-8624-462c-a5b2-9f7c92a23128]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd443df4-6e8e-47d3-811c-70f84ff0cfda]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b9e654-bada-4885-a983-2e42d75c4e62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260]
Oct 17 11:58:10 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260] successful.
Oct 17 11:58:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Instance spawned successfully.
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3294d812-120b-4a60-b285-fb46aae8abb1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc436bd1-3255-4035-9da2-90b08be5c233]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:10 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.528s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:58:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3841e7f-0260-4310-ae76-21c68756a75d]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:11 user nova-compute[74261]: INFO nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Took 7.48 seconds to spawn the instance on the hypervisor.
Oct 17 11:58:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:11 user nova-compute[74261]: INFO nova.compute.manager [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Took 8.53 seconds to build instance.
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8dc42b38-9570-4bd9-8192-81fdaaeee85e tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.647s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTBwkVXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.580s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== connect_volume: return (1583ms) {'type': 'block', 'scsi_wwn': '23761396566373632', 'path': '/dev/sdf'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761396566373632', 'path': '/dev/sdf'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'flavor' on Instance uuid 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:58:12 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:12 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 11:58:12 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:58:12 user nova-compute[74261]:   <serial>838adc28-bd04-4537-b244-ca94b926950f</serial>
Oct 17 11:58:12 user nova-compute[74261]: </disk>
Oct 17 11:58:12 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-changed-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Refreshing instance network info cache due to event network-changed-201cf343-4cde-41f1-b5c3-166f7583eb1d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Refreshing network info cache for port 201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] No VIF found with MAC fa:16:3e:86:e0:fe, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a45aad7b-e417-4c5d-ad3f-553c040d43ac tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.821s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updated VIF entry in instance network info cache for port 201cf343-4cde-41f1-b5c3-166f7583eb1d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-changed-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Refreshing instance network info cache due to event network-changed-51ae7fa5-0161-409c-b261-552e0fc76030. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] Acquiring lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] Acquired lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Refreshing network info cache for port 51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Stashing vm_state: active {{(pid=74261) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 17 11:58:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:14 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:58:14 user nova-compute[74261]: INFO nova.compute.claims [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Claim successful on node user
Oct 17 11:58:14 user nova-compute[74261]: INFO nova.compute.resource_tracker [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating resource usage from migration f63276d8-a20b-4cff-b733-129bda3d6801
Oct 17 11:58:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:58:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7346MB free_disk=25.149200439453125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updated VIF entry in instance network info cache for port 51ae7fa5-0161-409c-b261-552e0fc76030. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-546f56d1-3c39-4720-8d45-f0b257c34fd0 req-69778a49-7009-469c-8aca-59cda1d27f26 service nova] Releasing lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.222s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:15 user nova-compute[74261]: INFO nova.compute.manager [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Migrating
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.467s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:15 user nova-compute[74261]: INFO nova.compute.rpcapi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Applying migration context for instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e as it has an incoming, in-progress migration f63276d8-a20b-4cff-b733-129bda3d6801. Migration status is pre-migrating {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 17 11:58:15 user nova-compute[74261]: INFO nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating resource usage from migration f63276d8-a20b-4cff-b733-129bda3d6801
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d2a99562-808c-4d4a-bc06-ab50f7fa3972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 527e094a-0c2f-4867-bc71-29b05f4812da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 35114c87-8d9d-4156-8b9a-2b541e57fb9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Migration f63276d8-a20b-4cff-b733-129bda3d6801 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:58:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:16 user nova-compute[74261]: INFO nova.compute.manager [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attaching volume 48fff7a5-ad6a-44c3-954f-b753b62cab24 to /dev/vdc
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:16 user nova-compute[74261]: INFO nova.compute.manager [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Terminating instance
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG os_brick.utils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b603e-2edb-4011-92c8-2776ca09072f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b7488-cf6f-4d84-8da3-b306c0464c1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf56213-e78d-4faf-9c5b-2234e4192b01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ea7934-bb9e-4a40-b67e-9b69dd8fc543]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Starting migrate_disk_and_power_off {{(pid=74261) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:58:16 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f146c-0dea-4340-8967-3b9dad3137d7]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG os_brick.utils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updating existing volume attachment record: c4425f81-ab04-4c7f-bd58-8e84ebe4eff3 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-5a24c323-da06-4baf-9dc5-18486ec3c7e1 req-850de0d1-aa07-449a-aaa9-af30202a5b0a service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-vif-unplugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5a24c323-da06-4baf-9dc5-18486ec3c7e1 req-850de0d1-aa07-449a-aaa9-af30202a5b0a service nova] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5a24c323-da06-4baf-9dc5-18486ec3c7e1 req-850de0d1-aa07-449a-aaa9-af30202a5b0a service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5a24c323-da06-4baf-9dc5-18486ec3c7e1 req-850de0d1-aa07-449a-aaa9-af30202a5b0a service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-5a24c323-da06-4baf-9dc5-18486ec3c7e1 req-850de0d1-aa07-449a-aaa9-af30202a5b0a service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] No waiting events found dispatching network-vif-unplugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-5a24c323-da06-4baf-9dc5-18486ec3c7e1 req-850de0d1-aa07-449a-aaa9-af30202a5b0a service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-vif-unplugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-963b9c77-0254-4709-9581-74c20584b54a req-5e0095ad-6843-4f44-ad02-816b7332b31b service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-unplugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-963b9c77-0254-4709-9581-74c20584b54a req-5e0095ad-6843-4f44-ad02-816b7332b31b service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-963b9c77-0254-4709-9581-74c20584b54a req-5e0095ad-6843-4f44-ad02-816b7332b31b service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-963b9c77-0254-4709-9581-74c20584b54a req-5e0095ad-6843-4f44-ad02-816b7332b31b service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-963b9c77-0254-4709-9581-74c20584b54a req-5e0095ad-6843-4f44-ad02-816b7332b31b service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-unplugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:17 user nova-compute[74261]: WARNING nova.compute.manager [req-963b9c77-0254-4709-9581-74c20584b54a req-5e0095ad-6843-4f44-ad02-816b7332b31b service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-unplugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state active and task_state resize_migrating.
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Skipping network cache update for instance because it is being deleted. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid f0f6a950-d984-4ece-9a20-134bf800db37 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Instance destroyed successfully.
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.objects.instance [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'resources' on Instance uuid d2a99562-808c-4d4a-bc06-ab50f7fa3972 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance destroyed successfully.
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-101703142',display_name='tempest-ServerActionsTestOtherA-server-101703142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-101703142',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-4d8tromd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=33e3905d-6e09-4b49-b1fe-deff0d677b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-625886860',display_name='tempest-AttachVolumeNegativeTest-server-625886860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-625886860',id=26,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtky9NOHYajM6+Ut27mQVjzEWMjJq1newf16Gal3bSdRcgOWVjTYG9DO+6BszXgF4OD4yJRx6Tu9XemraPAKWkEdUtu6uIe/S8u13s+lRUt0KWMnIm9S7TWWoUs9s9oOQ==',key_name='tempest-keypair-327474104',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:55:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-zbq0zfu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=d2a99562-808c-4d4a-bc06-ab50f7fa3972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "address": "fa:16:3e:a3:73:4f", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c1f38-6b", "ovs_interfaceid": "514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_vif [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ae7fa5-01, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap514c1f38-6b, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f1d110f-6481-4722-a98c-bfd4c7680170) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3150121-63d3-4c24-91e3-54595b2784a6) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:17 user nova-compute[74261]: INFO os_vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01')
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:17 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:17 user nova-compute[74261]: INFO os_vif [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:73:4f,bridge_name='br-int',has_traffic_filtering=True,id=514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c1f38-6b')
Oct 17 11:58:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Deleting instance files /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972_del
Oct 17 11:58:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Deletion of /opt/stack/data/nova/instances/d2a99562-808c-4d4a-bc06-ab50f7fa3972_del complete
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ccb63f-9791-4daf-a24b-1af60736274f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:58:17 user nova-compute[74261]: No targets found.
Oct 17 11:58:17 user nova-compute[74261]: iSNS:
Oct 17 11:58:17 user nova-compute[74261]: No targets found.
Oct 17 11:58:17 user nova-compute[74261]: STATIC:
Oct 17 11:58:17 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164
Oct 17 11:58:17 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:17 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:17 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 11:58:17 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:17 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:17 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f
Oct 17 11:58:17 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:17 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:17 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:58:17 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:17 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:17 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20
Oct 17 11:58:17 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:17 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:17 user nova-compute[74261]: FIRMWARE:
Oct 17 11:58:17 user nova-compute[74261]: No targets found.
Oct 17 11:58:17 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:58:17 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:58:17 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee749073-58bd-4d90-a50a-20ab3c27ed28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf458f7d-619e-4c9a-90d5-eeb3c894bba5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:17 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:17 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:17 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c193d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:58:17 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:58:17 user nova-compute[74261]: INFO nova.compute.manager [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Took 1.62 seconds to destroy the instance on the hypervisor.
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a66878-ba42-4e93-95ed-10b3ad488e08]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b6c28-6f5a-4247-97ed-611af16fe504]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc7465f-b1e3-475a-be7a-2dfada85378b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d549f05b-3b3c-4b82-b7a3-29ef2852afc6]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO96f6bc76-3327cb9bb9a0393e', '/dev/disk/by-id/scsi-23333323763623962', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_96f6bc76') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 11:58:18 user nova-compute[74261]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO96f6bc76-3327cb9bb9a0393e
Oct 17 11:58:18 user nova-compute[74261]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23333323763623962
Oct 17 11:58:18 user nova-compute[74261]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_96f6bc76
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc7cae7-5276-4c0d-a0e1-c94be716b07a]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5210bc2e-8916-40be-bf24-b6593319ab59]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ebea9-f823-4d96-b297-92a6e35e6045]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]
Oct 17 11:58:18 user nova-compute[74261]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.
Oct 17 11:58:18 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e24445d-dbd8-4d14-aa19-c6ca9936d2ae]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== disconnect_volume: return (427ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [{"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f0f6a950-d984-4ece-9a20-134bf800db37" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:58:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing instance network info cache due to event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-50848b23-994b-4afc-8963-6f89cec1f7e6 req-2ec8b2f2-34d0-4d53-8b2b-2c90760a7267 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-50848b23-994b-4afc-8963-6f89cec1f7e6 req-2ec8b2f2-34d0-4d53-8b2b-2c90760a7267 service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-50848b23-994b-4afc-8963-6f89cec1f7e6 req-2ec8b2f2-34d0-4d53-8b2b-2c90760a7267 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-50848b23-994b-4afc-8963-6f89cec1f7e6 req-2ec8b2f2-34d0-4d53-8b2b-2c90760a7267 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-50848b23-994b-4afc-8963-6f89cec1f7e6 req-2ec8b2f2-34d0-4d53-8b2b-2c90760a7267 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:19 user nova-compute[74261]: WARNING nova.compute.manager [req-50848b23-994b-4afc-8963-6f89cec1f7e6 req-2ec8b2f2-34d0-4d53-8b2b-2c90760a7267 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state active and task_state resize_migrating.
Oct 17 11:58:19 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Took 1.15 seconds to deallocate network for instance.
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Port 51ae7fa5-0161-409c-b261-552e0fc76030 binding to destination host user is already ACTIVE {{(pid=74261) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:19 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Deleted allocations for instance d2a99562-808c-4d4a-bc06-ab50f7fa3972
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updated VIF entry in instance network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] Acquiring lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] No waiting events found dispatching network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:19 user nova-compute[74261]: WARNING nova.compute.manager [req-1cf5f745-6c5b-486d-a4b1-82094a4a6a17 req-b5d62d93-38ed-43c0-9cdb-38863f7d38bc service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received unexpected event network-vif-plugged-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef for instance with vm_state active and task_state deleting.
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-50aa34c5-7ba6-491b-82ca-2bc0e82fdc67 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "d2a99562-808c-4d4a-bc06-ab50f7fa3972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.617s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG os_brick.utils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[577e76b9-d20a-494c-87d0-2fe77db8c1eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1021c79c-9431-40eb-96ae-642b969e22ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95c04f-bc46-4434-aaa2-448b23420455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f3b6a-2681-41e8-bbd9-64d6a4cd0505]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:58:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:58:21 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:58:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[219abd63-21e0-4049-af3a-4f22286a25fc]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG os_brick.utils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-469c5363-c0e7-46bd-bd16-60ecaa0c90a7 req-af2aa8cd-007b-4618-a19d-5544f64ff14e service nova] [instance: d2a99562-808c-4d4a-bc06-ab50f7fa3972] Received event network-vif-deleted-514c1f38-6bfd-4b0b-8ac2-ebd068bb5bef {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:22 user nova-compute[74261]: INFO nova.compute.manager [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Rebooting instance
Oct 17 11:58:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:58:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing instance network info cache due to event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:58:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:58:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:58:23 user nova-compute[74261]: DEBUG nova.network.neutron [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:58:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updated VIF entry in instance network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:58:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:58:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7207546-2c80-4fc0-abf5-e7c6a99be65f req-d41dfee1-feb0-4ba0-9005-a452f35cd2d8 service nova] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-a46295b5-2b0f-4436-8e67-f1b0f1112d99 req-6138aa12-0ab1-4eb6-bfcb-e4925882a5e5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a46295b5-2b0f-4436-8e67-f1b0f1112d99 req-6138aa12-0ab1-4eb6-bfcb-e4925882a5e5 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a46295b5-2b0f-4436-8e67-f1b0f1112d99 req-6138aa12-0ab1-4eb6-bfcb-e4925882a5e5 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a46295b5-2b0f-4436-8e67-f1b0f1112d99 req-6138aa12-0ab1-4eb6-bfcb-e4925882a5e5 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-a46295b5-2b0f-4436-8e67-f1b0f1112d99 req-6138aa12-0ab1-4eb6-bfcb-e4925882a5e5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:25 user nova-compute[74261]: WARNING nova.compute.manager [req-a46295b5-2b0f-4436-8e67-f1b0f1112d99 req-6138aa12-0ab1-4eb6-bfcb-e4925882a5e5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state active and task_state reboot_started.
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance shutdown successfully.
Oct 17 11:58:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-a72bbe08-90a5-44f5-93a0-dc36ef5522f9 req-2b00a9d0-7c3a-48ef-8fed-902ef7bec5aa service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a72bbe08-90a5-44f5-93a0-dc36ef5522f9 req-2b00a9d0-7c3a-48ef-8fed-902ef7bec5aa service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a72bbe08-90a5-44f5-93a0-dc36ef5522f9 req-2b00a9d0-7c3a-48ef-8fed-902ef7bec5aa service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a72bbe08-90a5-44f5-93a0-dc36ef5522f9 req-2b00a9d0-7c3a-48ef-8fed-902ef7bec5aa service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-a72bbe08-90a5-44f5-93a0-dc36ef5522f9 req-2b00a9d0-7c3a-48ef-8fed-902ef7bec5aa service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:27 user nova-compute[74261]: WARNING nova.compute.manager [req-a72bbe08-90a5-44f5-93a0-dc36ef5522f9 req-2b00a9d0-7c3a-48ef-8fed-902ef7bec5aa service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state active and task_state reboot_started.
Oct 17 11:58:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:29 user nova-compute[74261]: WARNING nova.compute.manager [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state active and task_state reboot_started.
Oct 17 11:58:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:29 user nova-compute[74261]: WARNING nova.compute.manager [req-23dff99e-4dfc-4e19-8e1e-260c764e7265 req-9b333d4d-8041-4996-95ab-07793d7f46c8 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state active and task_state reboot_started.
Oct 17 11:58:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance running successfully.
Oct 17 11:58:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance soft rebooted successfully.
Oct 17 11:58:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:58:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6f6365e-b2f4-4afe-b7bf-0b8d8e5b56b9 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.594s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:31 user nova-compute[74261]: INFO nova.compute.manager [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Detaching volume f9803343-52c2-4a6c-966e-54f186769d20
Oct 17 11:58:31 user nova-compute[74261]: INFO nova.virt.block_device [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Attempting to driver detach volume f9803343-52c2-4a6c-966e-54f186769d20 from mountpoint /dev/vdc
Oct 17 11:58:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Attempting to detach device vdc from instance 527e094a-0c2f-4867-bc71-29b05f4812da from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:58:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:58:31 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:31 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 11:58:31 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 11:58:31 user nova-compute[74261]:   <serial>f9803343-52c2-4a6c-966e-54f186769d20</serial>
Oct 17 11:58:31 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:58:31 user nova-compute[74261]: </disk>
Oct 17 11:58:31 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:58:31 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully detached device vdc from instance 527e094a-0c2f-4867-bc71-29b05f4812da from the persistent domain config.
Oct 17 11:58:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 527e094a-0c2f-4867-bc71-29b05f4812da from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:58:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:58:31 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:31 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 11:58:31 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 11:58:31 user nova-compute[74261]:   <serial>f9803343-52c2-4a6c-966e-54f186769d20</serial>
Oct 17 11:58:31 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 11:58:31 user nova-compute[74261]: </disk>
Oct 17 11:58:31 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:58:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:58:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUlTgOou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:37 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:37 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:37 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e6a8f2-015b-473f-bcac-da97b07ac111]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:58:37 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed19e6bf-da57-445a-9f3e-cec2144ce9d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24] added
Oct 17 11:58:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df4d0d-f689-4e4e-929b-2e21709622a5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326436c-252a-48b7-971c-a672ac175361]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUlTgOou {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUlTgOou" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17325a-3471-4df2-b0c1-b61adf551942]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xUlTgOou'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c75de7-74fd-4d27-8bfd-7d1db0415523]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4bdff5-e3e3-4e79-a8fc-6d31b60409f2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a17b24-a3c0-4d95-83e4-7a53792eca45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260]
Oct 17 11:58:37 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260] successful.
Oct 17 11:58:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3d193-f04b-4645-9c95-e6af8f1f07d5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565c1d4-fd3b-48ee-9757-196035ef4af8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:37 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[69909a82-a555-4ac3-b251-507f8c308402]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUlTgOou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:58:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23161653834656265', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653834656265', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:58:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:58:38 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:38 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:58:38 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 11:58:38 user nova-compute[74261]:   <serial>48fff7a5-ad6a-44c3-954f-b753b62cab24</serial>
Oct 17 11:58:38 user nova-compute[74261]: </disk>
Oct 17 11:58:38 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] No VIF found with MAC fa:16:3e:b5:b4:71, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-3688740e-303c-4433-aa3b-857495baf6db tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.893s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:39 user nova-compute[74261]: INFO nova.compute.manager [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Detaching volume afe2e8ce-13bb-4748-8b9d-9794797a6164
Oct 17 11:58:40 user nova-compute[74261]: INFO nova.virt.block_device [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attempting to driver detach volume afe2e8ce-13bb-4748-8b9d-9794797a6164 from mountpoint /dev/vdb
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Attempting to detach device vdb from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:58:40 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:40 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:58:40 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:58:40 user nova-compute[74261]:   <serial>afe2e8ce-13bb-4748-8b9d-9794797a6164</serial>
Oct 17 11:58:40 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:58:40 user nova-compute[74261]: </disk>
Oct 17 11:58:40 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:58:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully detached device vdb from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the persistent domain config.
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:58:40 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:40 user nova-compute[74261]:   <source dev="/dev/sde"/>
Oct 17 11:58:40 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:58:40 user nova-compute[74261]:   <serial>afe2e8ce-13bb-4748-8b9d-9794797a6164</serial>
Oct 17 11:58:40 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 11:58:40 user nova-compute[74261]: </disk>
Oct 17 11:58:40 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Starting finish_migration {{(pid=74261) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 11:58:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Creating image(s)
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Ensure instance console log exists: /opt/stack/data/nova/instances/33e3905d-6e09-4b49-b1fe-deff0d677b1e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Start _get_guest_xml network_info=[{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '08b17b41-aa6c-46b0-bdd3-9b6a92741eae', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '33e3905d-6e09-4b49-b1fe-deff0d677b1e', 'attached_at': '2023-10-17T11:58:40.000000', 'detached_at': '', 'volume_id': 'a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'serial': 'a9822d0e-a521-405d-9f3f-82ea5a209ca9'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:58:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:58:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:40 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59624f4-fbe7-48ab-b478-a236363523a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:58:40 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5550a-0878-4736-a0f4-0cd22d6106a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9] added
Oct 17 11:58:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c38e0f3-938c-45fe-8c5a-57f90505cf6c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebcdbd7-263e-457e-92bc-5e634968b7ed]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HjqrexZB {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HjqrexZB" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec493ca1-077c-4ab1-a984-48680dbc2c88]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HjqrexZB'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f04dfd-3c46-470c-8b3a-347b9b0f81ab]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703e6ec-ee3c-4e8e-bff0-f2b00beec471]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa6f064-bce3-4030-a436-5dcd50368dba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]
Oct 17 11:58:40 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.
Oct 17 11:58:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[839980ef-9a20-4d40-a76e-790d456d2612]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faf8c22-0b7a-40c4-a557-fbbd58b7db9a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fecf83-b200-4408-8c3e-642b2d775309]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:58:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23333323763623962', 'path': '/dev/sdg'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333323763623962', 'path': '/dev/sdg'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-101703142',display_name='tempest-ServerActionsTestOtherA-server-101703142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-101703142',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-4d8tromd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:58:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=33e3905d-6e09-4b49-b1fe-deff0d677b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:58:41 user nova-compute[74261]:   <uuid>33e3905d-6e09-4b49-b1fe-deff0d677b1e</uuid>
Oct 17 11:58:41 user nova-compute[74261]:   <name>instance-0000001d</name>
Oct 17 11:58:41 user nova-compute[74261]:   <memory>2097152</memory>
Oct 17 11:58:41 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:58:41 user nova-compute[74261]:   <metadata>
Oct 17 11:58:41 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:58:41 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:58:41 user nova-compute[74261]:       <nova:name>tempest-ServerActionsTestOtherA-server-101703142</nova:name>
Oct 17 11:58:41 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:58:40</nova:creationTime>
Oct 17 11:58:41 user nova-compute[74261]:       <nova:flavor name="m1.small">
Oct 17 11:58:41 user nova-compute[74261]:         <nova:memory>2048</nova:memory>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:disk>20</nova:disk>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:58:41 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:58:41 user nova-compute[74261]:       <nova:owner>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:user uuid="4f29e0ea554e49c6b7ea83629e0f88c6">tempest-ServerActionsTestOtherA-203196858-project-member</nova:user>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:project uuid="8e92694390284b84b82715d4086494e9">tempest-ServerActionsTestOtherA-203196858</nova:project>
Oct 17 11:58:41 user nova-compute[74261]:       </nova:owner>
Oct 17 11:58:41 user nova-compute[74261]:       <nova:ports>
Oct 17 11:58:41 user nova-compute[74261]:         <nova:port uuid="51ae7fa5-0161-409c-b261-552e0fc76030">
Oct 17 11:58:41 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 11:58:41 user nova-compute[74261]:         </nova:port>
Oct 17 11:58:41 user nova-compute[74261]:       </nova:ports>
Oct 17 11:58:41 user nova-compute[74261]:     </nova:instance>
Oct 17 11:58:41 user nova-compute[74261]:   </metadata>
Oct 17 11:58:41 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:58:41 user nova-compute[74261]:     <system>
Oct 17 11:58:41 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:58:41 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:58:41 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:58:41 user nova-compute[74261]:       <entry name="serial">33e3905d-6e09-4b49-b1fe-deff0d677b1e</entry>
Oct 17 11:58:41 user nova-compute[74261]:       <entry name="uuid">33e3905d-6e09-4b49-b1fe-deff0d677b1e</entry>
Oct 17 11:58:41 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:58:41 user nova-compute[74261]:     </system>
Oct 17 11:58:41 user nova-compute[74261]:   </sysinfo>
Oct 17 11:58:41 user nova-compute[74261]:   <os>
Oct 17 11:58:41 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:58:41 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:58:41 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:58:41 user nova-compute[74261]:   </os>
Oct 17 11:58:41 user nova-compute[74261]:   <features>
Oct 17 11:58:41 user nova-compute[74261]:     <acpi/>
Oct 17 11:58:41 user nova-compute[74261]:     <apic/>
Oct 17 11:58:41 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:58:41 user nova-compute[74261]:   </features>
Oct 17 11:58:41 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:58:41 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:58:41 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:58:41 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:58:41 user nova-compute[74261]:   </clock>
Oct 17 11:58:41 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:58:41 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:58:41 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:58:41 user nova-compute[74261]:   </cpu>
Oct 17 11:58:41 user nova-compute[74261]:   <devices>
Oct 17 11:58:41 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 11:58:41 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:58:41 user nova-compute[74261]:       <source dev="/dev/sdg"/>
Oct 17 11:58:41 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:58:41 user nova-compute[74261]:       <serial>a9822d0e-a521-405d-9f3f-82ea5a209ca9</serial>
Oct 17 11:58:41 user nova-compute[74261]:     </disk>
Oct 17 11:58:41 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:58:41 user nova-compute[74261]:       <mac address="fa:16:3e:5c:94:c7"/>
Oct 17 11:58:41 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:58:41 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:58:41 user nova-compute[74261]:       <target dev="tap51ae7fa5-01"/>
Oct 17 11:58:41 user nova-compute[74261]:     </interface>
Oct 17 11:58:41 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:58:41 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/33e3905d-6e09-4b49-b1fe-deff0d677b1e/console.log" append="off"/>
Oct 17 11:58:41 user nova-compute[74261]:     </serial>
Oct 17 11:58:41 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:58:41 user nova-compute[74261]:     <video>
Oct 17 11:58:41 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:58:41 user nova-compute[74261]:     </video>
Oct 17 11:58:41 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:58:41 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:58:41 user nova-compute[74261]:     </rng>
Oct 17 11:58:41 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:58:41 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:58:41 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:58:41 user nova-compute[74261]:     </memballoon>
Oct 17 11:58:41 user nova-compute[74261]:   </devices>
Oct 17 11:58:41 user nova-compute[74261]: </domain>
Oct 17 11:58:41 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-101703142',display_name='tempest-ServerActionsTestOtherA-server-101703142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-101703142',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-4d8tromd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:58:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=33e3905d-6e09-4b49-b1fe-deff0d677b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1651452110-network", "vif_mac": "fa:16:3e:5c:94:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG os_vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '126ceba3-cef2-5c9e-879a-31d1d7b17566', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ae7fa5-01, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ae7fa5-01, col_values=(('qos', UUID('f873f26b-0d4d-4889-9faa-9c1f608eef73')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ae7fa5-01, col_values=(('external_ids', {'iface-id': '51ae7fa5-0161-409c-b261-552e0fc76030', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:94:c7', 'vm-uuid': '33e3905d-6e09-4b49-b1fe-deff0d677b1e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:41 user nova-compute[74261]: INFO os_vif [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01')
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:58:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] No VIF found with MAC fa:16:3e:5c:94:c7, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a754bba-1a95-46da-ad32-e0b51e310214 req-a010a387-2b47-4c74-afc0-881fab127b16 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a754bba-1a95-46da-ad32-e0b51e310214 req-a010a387-2b47-4c74-afc0-881fab127b16 service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a754bba-1a95-46da-ad32-e0b51e310214 req-a010a387-2b47-4c74-afc0-881fab127b16 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4a754bba-1a95-46da-ad32-e0b51e310214 req-a010a387-2b47-4c74-afc0-881fab127b16 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-4a754bba-1a95-46da-ad32-e0b51e310214 req-a010a387-2b47-4c74-afc0-881fab127b16 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:43 user nova-compute[74261]: WARNING nova.compute.manager [req-4a754bba-1a95-46da-ad32-e0b51e310214 req-a010a387-2b47-4c74-afc0-881fab127b16 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state active and task_state resize_finish.
Oct 17 11:58:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-1d0e33c6-6414-463c-9d98-25d84d6dffd7 req-5c294a80-8ece-4a7b-bf1f-d2053dfbd065 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:58:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1d0e33c6-6414-463c-9d98-25d84d6dffd7 req-5c294a80-8ece-4a7b-bf1f-d2053dfbd065 service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:58:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1d0e33c6-6414-463c-9d98-25d84d6dffd7 req-5c294a80-8ece-4a7b-bf1f-d2053dfbd065 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:58:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1d0e33c6-6414-463c-9d98-25d84d6dffd7 req-5c294a80-8ece-4a7b-bf1f-d2053dfbd065 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-1d0e33c6-6414-463c-9d98-25d84d6dffd7 req-5c294a80-8ece-4a7b-bf1f-d2053dfbd065 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:58:45 user nova-compute[74261]: WARNING nova.compute.manager [req-1d0e33c6-6414-463c-9d98-25d84d6dffd7 req-5c294a80-8ece-4a7b-bf1f-d2053dfbd065 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state active and task_state resize_finish.
Oct 17 11:58:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:58:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance running successfully.
Oct 17 11:58:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Failed to set time: agent not configured {{(pid=74261) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 17 11:58:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-aa433b14-67ee-4be2-b444-9f9baab8b79b tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] finish_migration finished successfully. {{(pid=74261) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 17 11:58:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:51 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 527e094a-0c2f-4867-bc71-29b05f4812da is timed out.
Oct 17 11:58:51 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully detached device vdc from instance 527e094a-0c2f-4867-bc71-29b05f4812da from the live domain config.
Oct 17 11:58:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIKjCEHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:58:51 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5712c512-9024-4179-a6a1-2d866e9a6e1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:58:51 user nova-compute[74261]: No targets found.
Oct 17 11:58:51 user nova-compute[74261]: iSNS:
Oct 17 11:58:51 user nova-compute[74261]: No targets found.
Oct 17 11:58:51 user nova-compute[74261]: STATIC:
Oct 17 11:58:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164
Oct 17 11:58:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 11:58:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f
Oct 17 11:58:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24
Oct 17 11:58:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:58:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20
Oct 17 11:58:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:58:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:58:51 user nova-compute[74261]: FIRMWARE:
Oct 17 11:58:51 user nova-compute[74261]: No targets found.
Oct 17 11:58:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:58:51 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:58:51 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaebcb0-b880-474c-9161-f2ae6c12b406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b1c2c-4bbf-4b21-aa0c-f3e2c0c3d0e2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:58:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24232950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20'): ({'sdd'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Removing single pathed devices sdd {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:58:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[912ab781-b969-4110-9095-fddbf27dc7d5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab9e282-9ae8-44d2-8cea-b2fb31419dfc]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flushing IO for device /dev/sdd {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b628c430-c5a9-40de-a56e-0a5a85a98a70]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[329af941-500c-4607-a93a-031d5bbe5f5d]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[94086a6d-05a2-4734-a4c9-e28ef30566d0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d7c2e-6f97-4248-a853-09fcdf43dd62]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260]
Oct 17 11:58:52 user nova-compute[74261]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20, portal: 172.16.0.220,3260] successful.
Oct 17 11:58:52 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9803343-52c2-4a6c-966e-54f186769d20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9f685c-4bac-46e3-a642-58d14c6a0aa7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] <== disconnect_volume: return (327ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:58:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:58:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'flavor' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:58:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-890f2a66-3929-416c-9f47-003fcd700a5b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:58:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:58:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:00 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e is timed out.
Oct 17 11:59:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully detached device vdb from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the live domain config.
Oct 17 11:59:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEwcrUWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:59:00 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7215e53f-6370-40b8-ada5-1c641e3d9781]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:59:00 user nova-compute[74261]: No targets found.
Oct 17 11:59:00 user nova-compute[74261]: iSNS:
Oct 17 11:59:00 user nova-compute[74261]: No targets found.
Oct 17 11:59:00 user nova-compute[74261]: STATIC:
Oct 17 11:59:00 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164
Oct 17 11:59:00 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:00 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:00 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 11:59:00 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:00 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:00 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f
Oct 17 11:59:00 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:00 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:00 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24
Oct 17 11:59:00 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:00 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:00 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:59:00 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:00 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:00 user nova-compute[74261]: FIRMWARE:
Oct 17 11:59:00 user nova-compute[74261]: No targets found.
Oct 17 11:59:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:59:00 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:59:00 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6579cd2-ca3e-4ca1-9e2a-56641e24b9e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6ad82-8179-46bd-9b39-6c23dc671585]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b2d403370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164'): ({'sde'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Removing single pathed devices sde {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6994862-f0dc-4979-a2d5-1feec188ec2f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e84ce7-4526-43c5-9895-4fbfd1d76cd7]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flushing IO for device /dev/sde {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f60954-f47d-4da2-910c-29f9c35b86a8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e429432-587a-4c06-ae15-e793d0bac461]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9fe04-df25-47cc-b0f7-f82ba9d20362]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[be888410-a1de-45df-b911-00c3be601c06]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260]
Oct 17 11:59:00 user nova-compute[74261]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164, portal: 172.16.0.220,3260] successful.
Oct 17 11:59:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe2e8ce-13bb-4748-8b9d-9794797a6164 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[266e6ccd-005e-4018-a174-f8d3fbe12294]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== disconnect_volume: return (313ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:59:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:59:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8e87b872-4bda-4d5e-b6de-0b63b89a8c07 tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:02 user nova-compute[74261]: INFO nova.compute.manager [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Detaching volume 48fff7a5-ad6a-44c3-954f-b753b62cab24
Oct 17 11:59:02 user nova-compute[74261]: INFO nova.virt.block_device [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Attempting to driver detach volume 48fff7a5-ad6a-44c3-954f-b753b62cab24 from mountpoint /dev/vdc
Oct 17 11:59:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Attempting to detach device vdc from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 11:59:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:59:02 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:59:02 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:59:02 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 11:59:02 user nova-compute[74261]:   <serial>48fff7a5-ad6a-44c3-954f-b753b62cab24</serial>
Oct 17 11:59:02 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 11:59:02 user nova-compute[74261]: </disk>
Oct 17 11:59:02 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:59:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully detached device vdc from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the persistent domain config.
Oct 17 11:59:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 11:59:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 11:59:03 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:59:03 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:59:03 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 11:59:03 user nova-compute[74261]:   <serial>48fff7a5-ad6a-44c3-954f-b753b62cab24</serial>
Oct 17 11:59:03 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 11:59:03 user nova-compute[74261]: </disk>
Oct 17 11:59:03 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 11:59:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 11:59:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "a4628ad3-6edb-4038-bba4-05421317e568" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:59:10 user nova-compute[74261]: INFO nova.compute.claims [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Claim successful on node user
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:59:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:59:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.policy [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d191be36a54216a9e2d6a64660e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b95f3129c4493b0a69149e5b8dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:59:11 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Creating image(s)
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 11:59:11 user nova-compute[74261]: INFO nova.compute.claims [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Claim successful on node user
Oct 17 11:59:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.224s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.167s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk 1073741824" returned: 0 in 0.079s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Successfully created port: f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Cannot resize image /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:59:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Ensure instance console log exists: /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.868s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:12 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.policy [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '126186127bc44a85ac39bb6bfbb0b8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe4687b8ef41248f726f6ddd948216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Successfully updated port: f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-changed-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Refreshing instance network info cache due to event network-changed-f0b58352-413e-402a-b849-314f2e2302e0. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] Acquiring lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 11:59:12 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Creating image(s)
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "/opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Updating instance_info_cache with network_info: [{"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Instance network_info: |[{"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] Acquired lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.network.neutron [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Refreshing network info cache for port f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Start _get_guest_xml network_info=[{"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk 1073741824" returned: 0 in 0.078s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:59:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1981995023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1981995023',id=32,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-r56rpiso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:59:11Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=a4628ad3-6edb-4038-bba4-05421317e568,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'pci_devices' on Instance uuid a4628ad3-6edb-4038-bba4-05421317e568 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Successfully created port: e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.580s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:59:13 user nova-compute[74261]:   <uuid>a4628ad3-6edb-4038-bba4-05421317e568</uuid>
Oct 17 11:59:13 user nova-compute[74261]:   <name>instance-00000020</name>
Oct 17 11:59:13 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:59:13 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:59:13 user nova-compute[74261]:   <metadata>
Oct 17 11:59:13 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:59:13 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:59:13 user nova-compute[74261]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1981995023</nova:name>
Oct 17 11:59:13 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:59:13</nova:creationTime>
Oct 17 11:59:13 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:59:13 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:59:13 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:59:13 user nova-compute[74261]:       <nova:owner>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:user uuid="19d191be36a54216a9e2d6a64660e582">tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member</nova:user>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:project uuid="022b95f3129c4493b0a69149e5b8dd4e">tempest-ServerBootFromVolumeStableRescueTest-1400453141</nova:project>
Oct 17 11:59:13 user nova-compute[74261]:       </nova:owner>
Oct 17 11:59:13 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:59:13 user nova-compute[74261]:       <nova:ports>
Oct 17 11:59:13 user nova-compute[74261]:         <nova:port uuid="f0b58352-413e-402a-b849-314f2e2302e0">
Oct 17 11:59:13 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 11:59:13 user nova-compute[74261]:         </nova:port>
Oct 17 11:59:13 user nova-compute[74261]:       </nova:ports>
Oct 17 11:59:13 user nova-compute[74261]:     </nova:instance>
Oct 17 11:59:13 user nova-compute[74261]:   </metadata>
Oct 17 11:59:13 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:59:13 user nova-compute[74261]:     <system>
Oct 17 11:59:13 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:59:13 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:59:13 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:59:13 user nova-compute[74261]:       <entry name="serial">a4628ad3-6edb-4038-bba4-05421317e568</entry>
Oct 17 11:59:13 user nova-compute[74261]:       <entry name="uuid">a4628ad3-6edb-4038-bba4-05421317e568</entry>
Oct 17 11:59:13 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:59:13 user nova-compute[74261]:     </system>
Oct 17 11:59:13 user nova-compute[74261]:   </sysinfo>
Oct 17 11:59:13 user nova-compute[74261]:   <os>
Oct 17 11:59:13 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:59:13 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:59:13 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:59:13 user nova-compute[74261]:   </os>
Oct 17 11:59:13 user nova-compute[74261]:   <features>
Oct 17 11:59:13 user nova-compute[74261]:     <acpi/>
Oct 17 11:59:13 user nova-compute[74261]:     <apic/>
Oct 17 11:59:13 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:59:13 user nova-compute[74261]:   </features>
Oct 17 11:59:13 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:59:13 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:59:13 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:59:13 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:59:13 user nova-compute[74261]:   </clock>
Oct 17 11:59:13 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:59:13 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:59:13 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:59:13 user nova-compute[74261]:   </cpu>
Oct 17 11:59:13 user nova-compute[74261]:   <devices>
Oct 17 11:59:13 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:59:13 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:59:13 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk"/>
Oct 17 11:59:13 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:59:13 user nova-compute[74261]:     </disk>
Oct 17 11:59:13 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:59:13 user nova-compute[74261]:       <mac address="fa:16:3e:7d:e0:ee"/>
Oct 17 11:59:13 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:59:13 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:59:13 user nova-compute[74261]:       <target dev="tapf0b58352-41"/>
Oct 17 11:59:13 user nova-compute[74261]:     </interface>
Oct 17 11:59:13 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:59:13 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/console.log" append="off"/>
Oct 17 11:59:13 user nova-compute[74261]:     </serial>
Oct 17 11:59:13 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:59:13 user nova-compute[74261]:     <video>
Oct 17 11:59:13 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:59:13 user nova-compute[74261]:     </video>
Oct 17 11:59:13 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:59:13 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:59:13 user nova-compute[74261]:     </rng>
Oct 17 11:59:13 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:59:13 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:59:13 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:59:13 user nova-compute[74261]:     </memballoon>
Oct 17 11:59:13 user nova-compute[74261]:   </devices>
Oct 17 11:59:13 user nova-compute[74261]: </domain>
Oct 17 11:59:13 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1981995023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1981995023',id=32,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-r56rpiso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:59:11Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=a4628ad3-6edb-4038-bba4-05421317e568,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG os_vif [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84f57841-44ce-5c41-a3e1-a430264832ce', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:59:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7408MB free_disk=25.141399383544922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b58352-41, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0b58352-41, col_values=(('qos', UUID('96178207-d754-456c-af59-e0510f57203e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0b58352-41, col_values=(('external_ids', {'iface-id': 'f0b58352-413e-402a-b849-314f2e2302e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:e0:ee', 'vm-uuid': 'a4628ad3-6edb-4038-bba4-05421317e568'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:13 user nova-compute[74261]: INFO os_vif [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41')
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No VIF found with MAC fa:16:3e:7d:e0:ee, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Cannot resize image /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Applying migration context for instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e as it has an incoming, in-progress migration f63276d8-a20b-4cff-b733-129bda3d6801. Migration status is finished {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 17 11:59:13 user nova-compute[74261]: INFO nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating resource usage from migration f63276d8-a20b-4cff-b733-129bda3d6801
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 527e094a-0c2f-4867-bc71-29b05f4812da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 35114c87-8d9d-4156-8b9a-2b541e57fb9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Migration f63276d8-a20b-4cff-b733-129bda3d6801 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 11:59:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Updated VIF entry in instance network info cache for port f0b58352-413e-402a-b849-314f2e2302e0. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Updating instance_info_cache with network_info: [{"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c47e6d35-740a-42c5-a7ab-640d679ae803 req-0985251d-804f-4873-96ad-0433c633417a service nova] Releasing lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Successfully updated port: e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-changed-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Refreshing instance network info cache due to event network-changed-e1304226-7bae-46dc-a4a3-7bfd644292ec. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] Acquiring lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] Acquired lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Refreshing network info cache for port e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33886d72-9ddd-4892-b8b4-67dcb196f998 req-bb55f34b-91b1-4f1a-948b-a8318a47bd09 service nova] Releasing lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquired lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Updating instance_info_cache with network_info: [{"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Releasing lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Instance network_info: |[{"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 11:59:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Start _get_guest_xml network_info=[{"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 11:59:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:59:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2057197925',display_name='tempest-AttachVolumeNegativeTest-server-2057197925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2057197925',id=33,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp0Ztoxr2JQes2Ey2/8/FxABwrasci91lWdngLu4wC14tHqXTu1anpY3kSibPkYXElAv1eATPbbbJa1YxaG8OZLiWJreY6L/X4rWR64J+kkkyImMpKjt968CTKnGXmpSA==',key_name='tempest-keypair-558657562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-u500hg8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=2ed15423-71da-4dba-aee0-c1eae1e1a83f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] End _get_guest_xml xml=<domain type="kvm">
Oct 17 11:59:15 user nova-compute[74261]:   <uuid>2ed15423-71da-4dba-aee0-c1eae1e1a83f</uuid>
Oct 17 11:59:15 user nova-compute[74261]:   <name>instance-00000021</name>
Oct 17 11:59:15 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 11:59:15 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 11:59:15 user nova-compute[74261]:   <metadata>
Oct 17 11:59:15 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 11:59:15 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 11:59:15 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2057197925</nova:name>
Oct 17 11:59:15 user nova-compute[74261]:       <nova:creationTime>2023-10-17 11:59:15</nova:creationTime>
Oct 17 11:59:15 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 11:59:15 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 11:59:15 user nova-compute[74261]:       </nova:flavor>
Oct 17 11:59:15 user nova-compute[74261]:       <nova:owner>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:user uuid="126186127bc44a85ac39bb6bfbb0b8c6">tempest-AttachVolumeNegativeTest-1274994880-project-member</nova:user>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:project uuid="c2fe4687b8ef41248f726f6ddd948216">tempest-AttachVolumeNegativeTest-1274994880</nova:project>
Oct 17 11:59:15 user nova-compute[74261]:       </nova:owner>
Oct 17 11:59:15 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 11:59:15 user nova-compute[74261]:       <nova:ports>
Oct 17 11:59:15 user nova-compute[74261]:         <nova:port uuid="e1304226-7bae-46dc-a4a3-7bfd644292ec">
Oct 17 11:59:15 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 11:59:15 user nova-compute[74261]:         </nova:port>
Oct 17 11:59:15 user nova-compute[74261]:       </nova:ports>
Oct 17 11:59:15 user nova-compute[74261]:     </nova:instance>
Oct 17 11:59:15 user nova-compute[74261]:   </metadata>
Oct 17 11:59:15 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 11:59:15 user nova-compute[74261]:     <system>
Oct 17 11:59:15 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 11:59:15 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 11:59:15 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 11:59:15 user nova-compute[74261]:       <entry name="serial">2ed15423-71da-4dba-aee0-c1eae1e1a83f</entry>
Oct 17 11:59:15 user nova-compute[74261]:       <entry name="uuid">2ed15423-71da-4dba-aee0-c1eae1e1a83f</entry>
Oct 17 11:59:15 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 11:59:15 user nova-compute[74261]:     </system>
Oct 17 11:59:15 user nova-compute[74261]:   </sysinfo>
Oct 17 11:59:15 user nova-compute[74261]:   <os>
Oct 17 11:59:15 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 11:59:15 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 11:59:15 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 11:59:15 user nova-compute[74261]:   </os>
Oct 17 11:59:15 user nova-compute[74261]:   <features>
Oct 17 11:59:15 user nova-compute[74261]:     <acpi/>
Oct 17 11:59:15 user nova-compute[74261]:     <apic/>
Oct 17 11:59:15 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 11:59:15 user nova-compute[74261]:   </features>
Oct 17 11:59:15 user nova-compute[74261]:   <clock offset="utc">
Oct 17 11:59:15 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 11:59:15 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 11:59:15 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 11:59:15 user nova-compute[74261]:   </clock>
Oct 17 11:59:15 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 11:59:15 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 11:59:15 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 11:59:15 user nova-compute[74261]:   </cpu>
Oct 17 11:59:15 user nova-compute[74261]:   <devices>
Oct 17 11:59:15 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 11:59:15 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 11:59:15 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk"/>
Oct 17 11:59:15 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 11:59:15 user nova-compute[74261]:     </disk>
Oct 17 11:59:15 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 11:59:15 user nova-compute[74261]:       <mac address="fa:16:3e:ac:11:df"/>
Oct 17 11:59:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:59:15 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 11:59:15 user nova-compute[74261]:       <target dev="tape1304226-7b"/>
Oct 17 11:59:15 user nova-compute[74261]:     </interface>
Oct 17 11:59:15 user nova-compute[74261]:     <serial type="pty">
Oct 17 11:59:15 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/console.log" append="off"/>
Oct 17 11:59:15 user nova-compute[74261]:     </serial>
Oct 17 11:59:15 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 11:59:15 user nova-compute[74261]:     <video>
Oct 17 11:59:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 11:59:15 user nova-compute[74261]:     </video>
Oct 17 11:59:15 user nova-compute[74261]:     <rng model="virtio">
Oct 17 11:59:15 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 11:59:15 user nova-compute[74261]:     </rng>
Oct 17 11:59:15 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 11:59:15 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 11:59:15 user nova-compute[74261]:       <stats period="10"/>
Oct 17 11:59:15 user nova-compute[74261]:     </memballoon>
Oct 17 11:59:15 user nova-compute[74261]:   </devices>
Oct 17 11:59:15 user nova-compute[74261]: </domain>
Oct 17 11:59:15 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2057197925',display_name='tempest-AttachVolumeNegativeTest-server-2057197925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2057197925',id=33,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp0Ztoxr2JQes2Ey2/8/FxABwrasci91lWdngLu4wC14tHqXTu1anpY3kSibPkYXElAv1eATPbbbJa1YxaG8OZLiWJreY6L/X4rWR64J+kkkyImMpKjt968CTKnGXmpSA==',key_name='tempest-keypair-558657562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-u500hg8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=2ed15423-71da-4dba-aee0-c1eae1e1a83f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG os_vif [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47962e28-535a-5293-9047-c8ebcbf4d148', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1304226-7b, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1304226-7b, col_values=(('qos', UUID('09053d52-ca3b-4349-a930-ca25a5c8e605')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1304226-7b, col_values=(('external_ids', {'iface-id': 'e1304226-7bae-46dc-a4a3-7bfd644292ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:11:df', 'vm-uuid': '2ed15423-71da-4dba-aee0-c1eae1e1a83f'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: INFO os_vif [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b')
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:ac:11:df, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-6dd96e71-023f-4586-9c30-c217497415ad req-9e74df96-d101-44e5-90ef-4b8f67241cee service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6dd96e71-023f-4586-9c30-c217497415ad req-9e74df96-d101-44e5-90ef-4b8f67241cee service nova] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6dd96e71-023f-4586-9c30-c217497415ad req-9e74df96-d101-44e5-90ef-4b8f67241cee service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6dd96e71-023f-4586-9c30-c217497415ad req-9e74df96-d101-44e5-90ef-4b8f67241cee service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-6dd96e71-023f-4586-9c30-c217497415ad req-9e74df96-d101-44e5-90ef-4b8f67241cee service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] No waiting events found dispatching network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:15 user nova-compute[74261]: WARNING nova.compute.manager [req-6dd96e71-023f-4586-9c30-c217497415ad req-9e74df96-d101-44e5-90ef-4b8f67241cee service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received unexpected event network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 for instance with vm_state building and task_state spawning.
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] No waiting events found dispatching network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:17 user nova-compute[74261]: WARNING nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received unexpected event network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 for instance with vm_state building and task_state spawning.
Oct 17 11:59:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:17 user nova-compute[74261]: WARNING nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received unexpected event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with vm_state building and task_state spawning.
Oct 17 11:59:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:17 user nova-compute[74261]: WARNING nova.compute.manager [req-8f9e48bd-128a-4f04-8379-6b334296268b req-ab8dde99-ec42-4bfc-94fa-3338aad2850e service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received unexpected event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with vm_state building and task_state spawning.
Oct 17 11:59:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:59:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Instance spawned successfully.
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:18 user nova-compute[74261]: INFO nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Took 7.64 seconds to spawn the instance on the hypervisor.
Oct 17 11:59:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:59:18 user nova-compute[74261]: INFO nova.compute.manager [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Took 8.63 seconds to build instance.
Oct 17 11:59:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac745884-9652-4c51-a4f1-0f1a429f3cac tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "a4628ad3-6edb-4038-bba4-05421317e568" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.757s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 11:59:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Instance spawned successfully.
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 11:59:19 user nova-compute[74261]: INFO nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Took 6.69 seconds to spawn the instance on the hypervisor.
Oct 17 11:59:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 11:59:19 user nova-compute[74261]: INFO nova.compute.manager [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Took 8.11 seconds to build instance.
Oct 17 11:59:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd3b6bdf-d169-4dea-940c-fbc919f459e1 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.258s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:21 user nova-compute[74261]: INFO nova.compute.manager [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Terminating instance
Oct 17 11:59:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac210734-3b7f-46cf-82dc-a124345cbeac req-80994876-1b02-4350-ba2f-d7cc48388298 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac210734-3b7f-46cf-82dc-a124345cbeac req-80994876-1b02-4350-ba2f-d7cc48388298 service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac210734-3b7f-46cf-82dc-a124345cbeac req-80994876-1b02-4350-ba2f-d7cc48388298 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac210734-3b7f-46cf-82dc-a124345cbeac req-80994876-1b02-4350-ba2f-d7cc48388298 service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac210734-3b7f-46cf-82dc-a124345cbeac req-80994876-1b02-4350-ba2f-d7cc48388298 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac210734-3b7f-46cf-82dc-a124345cbeac req-80994876-1b02-4350-ba2f-d7cc48388298 service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Instance destroyed successfully.
Oct 17 11:59:22 user nova-compute[74261]: DEBUG nova.objects.instance [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'resources' on Instance uuid 527e094a-0c2f-4867-bc71-29b05f4812da {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T11:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-51782779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-51782779',id=24,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrC/4RdHpsq2imB2jjET73dzW7Rr/DjghQOLDW/UXYyzTHfBfO+vwF8aWnMIpWcG/xgtbOFiamQbdpez9ykrHCxt9dVWgH7Pxt76oQ92kuIN21rgT0nv0bmhxcTaFNyw==',key_name='tempest-keypair-1685563374',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:57:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-vlytl2r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=527e094a-0c2f-4867-bc71-29b05f4812da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "address": "fa:16:3e:b9:91:f6", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef1b19a-36", "ovs_interfaceid": "9ef1b19a-36ae-4c27-af51-de9dcf45f4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG os_vif [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ef1b19a-36, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05818838-cf74-47b2-82e2-9f1d80ad9fe9) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:22 user nova-compute[74261]: INFO os_vif [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:91:f6,bridge_name='br-int',has_traffic_filtering=True,id=9ef1b19a-36ae-4c27-af51-de9dcf45f4ad,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef1b19a-36')
Oct 17 11:59:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Deleting instance files /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da_del
Oct 17 11:59:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Deletion of /opt/stack/data/nova/instances/527e094a-0c2f-4867-bc71-29b05f4812da_del complete
Oct 17 11:59:22 user nova-compute[74261]: INFO nova.compute.manager [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 17 11:59:22 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:59:22 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:23 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e is timed out.
Oct 17 11:59:23 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully detached device vdc from instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e from the live domain config.
Oct 17 11:59:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUlTgOou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:59:23 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d7c053-5eb0-4317-8ab6-a84c547bb0b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 11:59:23 user nova-compute[74261]: No targets found.
Oct 17 11:59:23 user nova-compute[74261]: iSNS:
Oct 17 11:59:23 user nova-compute[74261]: No targets found.
Oct 17 11:59:23 user nova-compute[74261]: STATIC:
Oct 17 11:59:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 11:59:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f
Oct 17 11:59:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24
Oct 17 11:59:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 11:59:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 11:59:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 11:59:23 user nova-compute[74261]: FIRMWARE:
Oct 17 11:59:23 user nova-compute[74261]: No targets found.
Oct 17 11:59:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 11:59:23 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 11:59:23 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[faca62f6-dc2d-4580-aca5-169c4be77b08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabdbeb7-70bf-4681-95f4-b9af67fedf9f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:23 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:23 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:59:23 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:23 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:23 user nova-compute[74261]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 (non-flash)
Oct 17 11:59:23 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c4bba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b094d4c4-c217-4fb5-a6f6-4e1ffc0907be]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[266dadd7-ab07-4d24-9007-56ab2d42967f]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cfbc57-883a-4dba-80f3-c6e42d6a11ca]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0addbea-4e39-4870-a43d-35f3d5adce7a]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c7aa67-48ae-481f-8b9d-0a1446306d9b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Took 1.24 seconds to deallocate network for instance.
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d8f8a-15f6-4f9f-b95c-654fdffccf30]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260]
Oct 17 11:59:23 user nova-compute[74261]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24, portal: 172.16.0.220,3260] successful.
Oct 17 11:59:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48fff7a5-ad6a-44c3-954f-b753b62cab24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee701c2-135a-4127-a9e5-a07bd7d8ed41]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] <== disconnect_volume: return (396ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:59:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:24 user nova-compute[74261]: WARNING nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state deleted and task_state None.
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:24 user nova-compute[74261]: WARNING nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state deleted and task_state None.
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:24 user nova-compute[74261]: WARNING nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state deleted and task_state None.
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:24 user nova-compute[74261]: WARNING nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-unplugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state deleted and task_state None.
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Acquiring lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] Lock "527e094a-0c2f-4867-bc71-29b05f4812da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] No waiting events found dispatching network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:24 user nova-compute[74261]: WARNING nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received unexpected event network-vif-plugged-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad for instance with vm_state deleted and task_state None.
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-bb120d6e-7c45-439f-abe4-78792050a67a req-abbaa0a6-4f7d-4d31-b200-72b69e34ca3b service nova] [instance: 527e094a-0c2f-4867-bc71-29b05f4812da] Received event network-vif-deleted-9ef1b19a-36ae-4c27-af51-de9dcf45f4ad {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Deleted allocations for instance 527e094a-0c2f-4867-bc71-29b05f4812da
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2ba40bdb-9c2c-49ec-8bee-6b5b9a7944af tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "527e094a-0c2f-4867-bc71-29b05f4812da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.157s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG nova.objects.instance [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'flavor' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-48ce6900-99bd-4226-8cd2-35f6154d01cd tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:25 user nova-compute[74261]: INFO nova.compute.manager [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Terminating instance
Oct 17 11:59:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-195bedd9-129d-448f-be58-66381d5ecc1a req-f936d18c-534d-43ed-9364-34dce1eb63eb service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-unplugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-195bedd9-129d-448f-be58-66381d5ecc1a req-f936d18c-534d-43ed-9364-34dce1eb63eb service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-195bedd9-129d-448f-be58-66381d5ecc1a req-f936d18c-534d-43ed-9364-34dce1eb63eb service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-195bedd9-129d-448f-be58-66381d5ecc1a req-f936d18c-534d-43ed-9364-34dce1eb63eb service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-195bedd9-129d-448f-be58-66381d5ecc1a req-f936d18c-534d-43ed-9364-34dce1eb63eb service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-unplugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-195bedd9-129d-448f-be58-66381d5ecc1a req-f936d18c-534d-43ed-9364-34dce1eb63eb service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-unplugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Instance destroyed successfully.
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.objects.instance [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lazy-loading 'resources' on Instance uuid c60a7acc-a630-4f9f-98ca-8bea9467cc9e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912670388',display_name='tempest-AttachVolumeTestJSON-server-1912670388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912670388',id=27,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmCpERTYF5FwXZDWIliVyji4s+dDgm0DUDwrQygnwLKvAXz8LNMEHpKuqSv1Bu3hd9dVd9HQtKgFqpgzygI0bh731xWYlOJNN0svABPuDMEaIRNQbdsEg66ESHssfyLhw==',key_name='tempest-keypair-1015100600',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='743ac99ae6b44e43ab599e1731d79b3b',ramdisk_id='',reservation_id='r-7wmxwmb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691828841',owner_user_name='tempest-AttachVolumeTestJSON-1691828841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f0a17cbf46d422899c2dad6b8000fb3',uuid=c60a7acc-a630-4f9f-98ca-8bea9467cc9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converting VIF {"id": "c974e6b3-e867-4d94-afde-4d8599a853c2", "address": "fa:16:3e:b5:b4:71", "network": {"id": "cd09f009-3c41-43ff-9836-856007fcc526", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549100627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "743ac99ae6b44e43ab599e1731d79b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc974e6b3-e8", "ovs_interfaceid": "c974e6b3-e867-4d94-afde-4d8599a853c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG os_vif [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc974e6b3-e8, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=848f8e8f-9eef-404f-8b0f-93d94adaf4d5) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 11:59:26 user nova-compute[74261]: INFO os_vif [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=c974e6b3-e867-4d94-afde-4d8599a853c2,network=Network(cd09f009-3c41-43ff-9836-856007fcc526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc974e6b3-e8')
Oct 17 11:59:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Deleting instance files /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e_del
Oct 17 11:59:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Deletion of /opt/stack/data/nova/instances/c60a7acc-a630-4f9f-98ca-8bea9467cc9e_del complete
Oct 17 11:59:26 user nova-compute[74261]: INFO nova.compute.manager [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 17 11:59:26 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:59:26 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:59:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:28 user nova-compute[74261]: WARNING nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received unexpected event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with vm_state active and task_state deleting.
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:28 user nova-compute[74261]: WARNING nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received unexpected event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with vm_state active and task_state deleting.
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:28 user nova-compute[74261]: WARNING nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received unexpected event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with vm_state active and task_state deleting.
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-unplugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-unplugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-unplugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Acquiring lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] No waiting events found dispatching network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:28 user nova-compute[74261]: WARNING nova.compute.manager [req-a1cf0ba7-4967-4ab9-819e-9d20523f9744 req-bc816b12-d7ec-4266-8b4d-f3d949bbd755 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received unexpected event network-vif-plugged-c974e6b3-e867-4d94-afde-4d8599a853c2 for instance with vm_state active and task_state deleting.
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:28 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Took 1.50 seconds to deallocate network for instance.
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:59:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:29 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Deleted allocations for instance c60a7acc-a630-4f9f-98ca-8bea9467cc9e
Oct 17 11:59:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7e6b5777-95d5-48af-bac0-d2e75c3e27ab tempest-AttachVolumeTestJSON-1691828841 tempest-AttachVolumeTestJSON-1691828841-project-member] Lock "c60a7acc-a630-4f9f-98ca-8bea9467cc9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'flavor' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:30 user nova-compute[74261]: INFO nova.compute.manager [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Attaching volume 7d5c052b-d9a7-41dd-acc1-f199deb05e16 to /dev/vdb
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] [instance: c60a7acc-a630-4f9f-98ca-8bea9467cc9e] Received event network-vif-deleted-c974e6b3-e867-4d94-afde-4d8599a853c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing instance network info cache due to event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG os_brick.utils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cad736-e3d5-43da-9d36-92aba3c9e873]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[780cbf39-22c2-4331-93c2-76134405c7dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[39577158-ada0-4325-92f9-9be364157e11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d744510-908f-4d02-9889-1345f7c0044e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 11:59:30 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 11:59:30 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba68a2-dd85-4a3e-9795-cb80353d4b32]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG os_brick.utils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating existing volume attachment record: 7453966a-33d5-45cf-b135-bf4d99ce51ae {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updated VIF entry in instance network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 11:59:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b35d7057-3c1d-48eb-abda-212fdb29a7a1 req-b4f70661-b2cf-4192-82dd-eea34ba1d9d3 service nova] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 11:59:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:52 user nova-compute[74261]: INFO nova.compute.manager [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Terminating instance
Oct 17 11:59:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-86a6a537-681c-4c94-a4b0-f933dc54d2fb req-cea85755-584a-4643-8527-d99702f30882 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-vif-unplugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-86a6a537-681c-4c94-a4b0-f933dc54d2fb req-cea85755-584a-4643-8527-d99702f30882 service nova] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-86a6a537-681c-4c94-a4b0-f933dc54d2fb req-cea85755-584a-4643-8527-d99702f30882 service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-86a6a537-681c-4c94-a4b0-f933dc54d2fb req-cea85755-584a-4643-8527-d99702f30882 service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-86a6a537-681c-4c94-a4b0-f933dc54d2fb req-cea85755-584a-4643-8527-d99702f30882 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] No waiting events found dispatching network-vif-unplugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-86a6a537-681c-4c94-a4b0-f933dc54d2fb req-cea85755-584a-4643-8527-d99702f30882 service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-vif-unplugged-862500bc-8fff-4311-994e-5517783fe5c2 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 11:59:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Instance destroyed successfully.
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.objects.instance [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lazy-loading 'resources' on Instance uuid 35114c87-8d9d-4156-8b9a-2b541e57fb9f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-650448322',display_name='tempest-VolumesNegativeTest-instance-650448322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-650448322',id=31,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:58:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9d7389b272747cd9061bf4394d65701',ramdisk_id='',reservation_id='r-pr3ceb44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1124960665',owner_user_name='tempest-VolumesNegativeTest-1124960665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:58:11Z,user_data=None,user_id='ac64c9814bbf479fab67d3f8ae5bbebb',uuid=35114c87-8d9d-4156-8b9a-2b541e57fb9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Converting VIF {"id": "862500bc-8fff-4311-994e-5517783fe5c2", "address": "fa:16:3e:7a:c4:33", "network": {"id": "237875ec-be1d-41c7-b615-576eb67eb377", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7acc9a7fd01240a2bfa6fff17ea14622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap862500bc-8f", "ovs_interfaceid": "862500bc-8fff-4311-994e-5517783fe5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG os_vif [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap862500bc-8f, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b5faa93-7a67-431b-9c96-8a6f5f49dc4e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:53 user nova-compute[74261]: INFO os_vif [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c4:33,bridge_name='br-int',has_traffic_filtering=True,id=862500bc-8fff-4311-994e-5517783fe5c2,network=Network(237875ec-be1d-41c7-b615-576eb67eb377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862500bc-8f')
Oct 17 11:59:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Deleting instance files /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f_del
Oct 17 11:59:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Deletion of /opt/stack/data/nova/instances/35114c87-8d9d-4156-8b9a-2b541e57fb9f_del complete
Oct 17 11:59:53 user nova-compute[74261]: INFO nova.compute.manager [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 17 11:59:53 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 11:59:53 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 11:59:53 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Took 0.47 seconds to deallocate network for instance.
Oct 17 11:59:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:54 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 11:59:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 11:59:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:54 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Deleted allocations for instance 35114c87-8d9d-4156-8b9a-2b541e57fb9f
Oct 17 11:59:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-23912a40-e020-4d56-b8cf-0db0eb648314 tempest-VolumesNegativeTest-1124960665 tempest-VolumesNegativeTest-1124960665-project-member] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.919s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] Acquiring lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 11:59:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 11:59:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] Lock "35114c87-8d9d-4156-8b9a-2b541e57fb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 11:59:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] No waiting events found dispatching network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 11:59:55 user nova-compute[74261]: WARNING nova.compute.manager [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received unexpected event network-vif-plugged-862500bc-8fff-4311-994e-5517783fe5c2 for instance with vm_state deleted and task_state None.
Oct 17 11:59:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-b669a1e9-8672-4be5-8035-6e9f5f087dae req-e25b9e03-3af5-462a-9e55-04e6b9d2150e service nova] [instance: 35114c87-8d9d-4156-8b9a-2b541e57fb9f] Received event network-vif-deleted-862500bc-8fff-4311-994e-5517783fe5c2 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvCltdBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 11:59:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:59:57 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 11:59:57 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e629409a-7549-4166-8699-423be3606ca3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 11:59:57 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c83d1-d8b4-480f-b29d-74b75605af33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16] added
Oct 17 11:59:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6004d6-875d-4469-a07b-146e92442026]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f454cc-1c55-41ea-abed-ef3bacf7382c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvCltdBR {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvCltdBR" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[765dafa4-0922-4dc4-a0cc-9060cc76f386]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fvCltdBR'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cb7f33-b174-4879-88c5-d88b353aa62e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b2c02-6966-408b-889d-a78cf95b02dd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af79611-cb0d-4fa0-9c99-56493bcbd303]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260]
Oct 17 11:59:57 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260] successful.
Oct 17 11:59:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e579e9fb-086f-4763-9142-05317b4ca9b0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b58788-20cb-4b1f-8d06-fdef7d5bc130]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 11:59:57 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 11:59:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44ea887-49bb-4fd5-8e55-e3c03b47d687]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:59:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvCltdBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23461613265303364', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461613265303364', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'flavor' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 11:59:59 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 11:59:59 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 11:59:59 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 11:59:59 user nova-compute[74261]:   <serial>7d5c052b-d9a7-41dd-acc1-f199deb05e16</serial>
Oct 17 11:59:59 user nova-compute[74261]: </disk>
Oct 17 11:59:59 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:1b:70:17, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 11:59:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-94687809-66b0-4c26-82c2-6d2501497509 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.251s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:01 user nova-compute[74261]: INFO nova.compute.manager [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Rescuing
Oct 17 12:00:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-9ac760bf-3d10-4337-9e41-2e2a8cc3b69a req-5bcec66b-dcd9-4713-8ffa-19b64b3255c9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9ac760bf-3d10-4337-9e41-2e2a8cc3b69a req-5bcec66b-dcd9-4713-8ffa-19b64b3255c9 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9ac760bf-3d10-4337-9e41-2e2a8cc3b69a req-5bcec66b-dcd9-4713-8ffa-19b64b3255c9 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9ac760bf-3d10-4337-9e41-2e2a8cc3b69a req-5bcec66b-dcd9-4713-8ffa-19b64b3255c9 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-9ac760bf-3d10-4337-9e41-2e2a8cc3b69a req-5bcec66b-dcd9-4713-8ffa-19b64b3255c9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:00:01 user nova-compute[74261]: WARNING nova.compute.manager [req-9ac760bf-3d10-4337-9e41-2e2a8cc3b69a req-5bcec66b-dcd9-4713-8ffa-19b64b3255c9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state active and task_state rescuing.
Oct 17 12:00:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance destroyed successfully.
Oct 17 12:00:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Attempting rescue
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74261) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 12:00:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Creating image(s)
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue" returned: 0 in 0.053s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'migration_context' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.base [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<f9098343-8120-48b2-848b-2807bb60eb73> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Start _get_guest_xml network_info=[{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:1b:70:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'resources' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.base [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<f9098343-8120-48b2-848b-2807bb60eb73> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'numa_topology' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.base [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<f9098343-8120-48b2-848b-2807bb60eb73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:00:02 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:00:02 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.base [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<f9098343-8120-48b2-848b-2807bb60eb73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201570900',display_name='tempest-ServerRescueNegativeTestJSON-server-201570900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201570900',id=30,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeF/gSwlEeNPSISacTsorapNh7IBA53uRWQXmuM8RSeXmFBBNdMTfcNvMadaDVtgHyJRc9aqFfmXE20arIfd3+LiOx5t16Dmt8WpcMToXi6VKDz/d0ofOb8DeFuyL4LsA==',key_name='tempest-keypair-1480772815',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-nrri5545',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T11:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171d1037b5b74e09812373e40ef7c193',uuid=f9098343-8120-48b2-848b-2807bb60eb73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:1b:70:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "vif_mac": "fa:16:3e:1b:70:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'pci_devices' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.objects.base [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Object Instance<f9098343-8120-48b2-848b-2807bb60eb73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:00:02 user nova-compute[74261]:   <uuid>f9098343-8120-48b2-848b-2807bb60eb73</uuid>
Oct 17 12:00:02 user nova-compute[74261]:   <name>instance-0000001e</name>
Oct 17 12:00:02 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:00:02 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:00:02 user nova-compute[74261]:   <metadata>
Oct 17 12:00:02 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:00:02 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:00:02 user nova-compute[74261]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-201570900</nova:name>
Oct 17 12:00:02 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:00:02</nova:creationTime>
Oct 17 12:00:02 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:00:02 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:00:02 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:00:02 user nova-compute[74261]:       <nova:owner>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:user uuid="171d1037b5b74e09812373e40ef7c193">tempest-ServerRescueNegativeTestJSON-1673978463-project-member</nova:user>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:project uuid="ed0a71e6e0274702b67351ba09b91c7f">tempest-ServerRescueNegativeTestJSON-1673978463</nova:project>
Oct 17 12:00:02 user nova-compute[74261]:       </nova:owner>
Oct 17 12:00:02 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:00:02 user nova-compute[74261]:       <nova:ports>
Oct 17 12:00:02 user nova-compute[74261]:         <nova:port uuid="fed586ab-a4b9-4c76-8dae-1859edf00501">
Oct 17 12:00:02 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 12:00:02 user nova-compute[74261]:         </nova:port>
Oct 17 12:00:02 user nova-compute[74261]:       </nova:ports>
Oct 17 12:00:02 user nova-compute[74261]:     </nova:instance>
Oct 17 12:00:02 user nova-compute[74261]:   </metadata>
Oct 17 12:00:02 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:00:02 user nova-compute[74261]:     <system>
Oct 17 12:00:02 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:00:02 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:00:02 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:00:02 user nova-compute[74261]:       <entry name="serial">f9098343-8120-48b2-848b-2807bb60eb73</entry>
Oct 17 12:00:02 user nova-compute[74261]:       <entry name="uuid">f9098343-8120-48b2-848b-2807bb60eb73</entry>
Oct 17 12:00:02 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:00:02 user nova-compute[74261]:     </system>
Oct 17 12:00:02 user nova-compute[74261]:   </sysinfo>
Oct 17 12:00:02 user nova-compute[74261]:   <os>
Oct 17 12:00:02 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:00:02 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:00:02 user nova-compute[74261]:   </os>
Oct 17 12:00:02 user nova-compute[74261]:   <features>
Oct 17 12:00:02 user nova-compute[74261]:     <acpi/>
Oct 17 12:00:02 user nova-compute[74261]:     <apic/>
Oct 17 12:00:02 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:00:02 user nova-compute[74261]:   </features>
Oct 17 12:00:02 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:00:02 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:00:02 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:00:02 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:00:02 user nova-compute[74261]:   </clock>
Oct 17 12:00:02 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:00:02 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:00:02 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:00:02 user nova-compute[74261]:   </cpu>
Oct 17 12:00:02 user nova-compute[74261]:   <devices>
Oct 17 12:00:02 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:00:02 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:00:02 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue"/>
Oct 17 12:00:02 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:00:02 user nova-compute[74261]:     </disk>
Oct 17 12:00:02 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:00:02 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:00:02 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk"/>
Oct 17 12:00:02 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 12:00:02 user nova-compute[74261]:     </disk>
Oct 17 12:00:02 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:00:02 user nova-compute[74261]:       <mac address="fa:16:3e:1b:70:17"/>
Oct 17 12:00:02 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:00:02 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:00:02 user nova-compute[74261]:       <target dev="tapfed586ab-a4"/>
Oct 17 12:00:02 user nova-compute[74261]:     </interface>
Oct 17 12:00:02 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:00:02 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/console.log" append="off"/>
Oct 17 12:00:02 user nova-compute[74261]:     </serial>
Oct 17 12:00:02 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:00:02 user nova-compute[74261]:     <video>
Oct 17 12:00:02 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:00:02 user nova-compute[74261]:     </video>
Oct 17 12:00:02 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:00:02 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:00:02 user nova-compute[74261]:     </rng>
Oct 17 12:00:02 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:00:02 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:00:02 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:00:02 user nova-compute[74261]:     </memballoon>
Oct 17 12:00:02 user nova-compute[74261]:   </devices>
Oct 17 12:00:02 user nova-compute[74261]: </domain>
Oct 17 12:00:02 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:00:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance destroyed successfully.
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:00:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] No VIF found with MAC fa:16:3e:1b:70:17, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Going to confirm migration 1 {{(pid=74261) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquired lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG nova.network.neutron [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG nova.objects.instance [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'info_cache' on Instance uuid 33e3905d-6e09-4b49-b1fe-deff0d677b1e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0253ca9-7070-4548-a387-7f81b8f83166 req-fabbb2f9-622c-4e7d-90c6-c47d8fcbd867 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0253ca9-7070-4548-a387-7f81b8f83166 req-fabbb2f9-622c-4e7d-90c6-c47d8fcbd867 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0253ca9-7070-4548-a387-7f81b8f83166 req-fabbb2f9-622c-4e7d-90c6-c47d8fcbd867 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c0253ca9-7070-4548-a387-7f81b8f83166 req-fabbb2f9-622c-4e7d-90c6-c47d8fcbd867 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-c0253ca9-7070-4548-a387-7f81b8f83166 req-fabbb2f9-622c-4e7d-90c6-c47d8fcbd867 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:00:03 user nova-compute[74261]: WARNING nova.compute.manager [req-c0253ca9-7070-4548-a387-7f81b8f83166 req-fabbb2f9-622c-4e7d-90c6-c47d8fcbd867 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state active and task_state rescuing.
Oct 17 12:00:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG nova.network.neutron [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [{"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Releasing lock "refresh_cache-33e3905d-6e09-4b49-b1fe-deff0d677b1e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG nova.objects.instance [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'migration_context' on Instance uuid 33e3905d-6e09-4b49-b1fe-deff0d677b1e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG nova.objects.base [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Object Instance<33e3905d-6e09-4b49-b1fe-deff0d677b1e> lazy-loaded attributes: info_cache,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:00:04 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:00:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.610s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:05 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Deleted allocation for migration f63276d8-a20b-4cff-b733-129bda3d6801
Oct 17 12:00:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-93861a5c-654d-45d0-8721-60573e617dee tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.680s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:00:06 user nova-compute[74261]: WARNING nova.compute.manager [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state active and task_state rescuing.
Oct 17 12:00:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:00:06 user nova-compute[74261]: WARNING nova.compute.manager [req-52bc5bc5-47f0-4312-ad2c-eccca372fbaa req-0d560b86-f059-400e-9b55-0ec3ab0fd21b service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state active and task_state rescuing.
Oct 17 12:00:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:06 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c0cbcfe1-1050-4c74-87e9-4ae6e3b630d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:00:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:00:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:00:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:00:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.15563201904297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing instance network info cache due to event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.network.neutron [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:00:14 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.307s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updated VIF entry in instance network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9d40bd94-80b5-4447-b154-55fcfe09624e req-b124b9b8-a3c9-419c-a4cc-6d492bd5a802 service nova] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing instance network info cache due to event network-changed-70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] Acquiring lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] Acquired lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Refreshing network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updating instance_info_cache with network_info: [{"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-a590a88c-15ce-478b-976d-7e1828eee2bf" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:16 user nova-compute[74261]: INFO nova.compute.manager [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Detaching volume 838adc28-bd04-4537-b244-ca94b926950f
Oct 17 12:00:16 user nova-compute[74261]: INFO nova.virt.block_device [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Attempting to driver detach volume 838adc28-bd04-4537-b244-ca94b926950f from mountpoint /dev/vdb
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Attempting to detach device vdb from instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:00:16 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:00:16 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 12:00:16 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:00:16 user nova-compute[74261]:   <serial>838adc28-bd04-4537-b244-ca94b926950f</serial>
Oct 17 12:00:16 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:00:16 user nova-compute[74261]: </disk>
Oct 17 12:00:16 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:00:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully detached device vdb from instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 from the persistent domain config.
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:00:16 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:00:16 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 12:00:16 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:00:16 user nova-compute[74261]:   <serial>838adc28-bd04-4537-b244-ca94b926950f</serial>
Oct 17 12:00:16 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:00:16 user nova-compute[74261]: </disk>
Oct 17 12:00:16 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updated VIF entry in instance network info cache for port 70a735cf-0293-43f6-8fcb-8bd26aa5d779. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [{"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7df4d27c-8515-421f-a8de-5cf9cb746a50 req-187057e1-7ff8-4477-b93f-00c296a982f0 service nova] Releasing lock "refresh_cache-76352fb0-a0b9-4b4b-b00e-b7878cdd4725" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:00:16 user nova-compute[74261]: INFO nova.compute.claims [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Claim successful on node user
Oct 17 12:00:16 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:00:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.policy [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '229ff57765914e75a370db408f67c501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117fbb67e9764c1e9e3211ba9a08b864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:00:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Creating image(s)
Oct 17 12:00:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.235s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk 1073741824" returned: 0 in 0.056s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Successfully created port: d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Cannot resize image /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Successfully updated port: d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing instance network info cache due to event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance network_info: |[{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Start _get_guest_xml network_info=[{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:00:19 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:00:19 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-150427143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-150427143',id=34,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWjS+gY4aAH9DctNbNzzJABZRomTsctDrQNMZiAmKKGFO/0jB+KMeJj9hXxFhroWX9C3bLFdBngA195hhAZPaDKEeJsnclim8fbwnLrI7vYLQmzIs98EGg0g/n1Top0Yg==',key_name='tempest-keypair-817985384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-ua1yvbj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=7c9b0f63-db8b-4314-b916-56e9dc65b675,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:00:19 user nova-compute[74261]:   <uuid>7c9b0f63-db8b-4314-b916-56e9dc65b675</uuid>
Oct 17 12:00:19 user nova-compute[74261]:   <name>instance-00000022</name>
Oct 17 12:00:19 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:00:19 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:00:19 user nova-compute[74261]:   <metadata>
Oct 17 12:00:19 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:00:19 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:00:19 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-150427143</nova:name>
Oct 17 12:00:19 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:00:19</nova:creationTime>
Oct 17 12:00:19 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:00:19 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:00:19 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:00:19 user nova-compute[74261]:       <nova:owner>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:user uuid="229ff57765914e75a370db408f67c501">tempest-AttachVolumeShelveTestJSON-63868510-project-member</nova:user>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:project uuid="117fbb67e9764c1e9e3211ba9a08b864">tempest-AttachVolumeShelveTestJSON-63868510</nova:project>
Oct 17 12:00:19 user nova-compute[74261]:       </nova:owner>
Oct 17 12:00:19 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:00:19 user nova-compute[74261]:       <nova:ports>
Oct 17 12:00:19 user nova-compute[74261]:         <nova:port uuid="d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17">
Oct 17 12:00:19 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 12:00:19 user nova-compute[74261]:         </nova:port>
Oct 17 12:00:19 user nova-compute[74261]:       </nova:ports>
Oct 17 12:00:19 user nova-compute[74261]:     </nova:instance>
Oct 17 12:00:19 user nova-compute[74261]:   </metadata>
Oct 17 12:00:19 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:00:19 user nova-compute[74261]:     <system>
Oct 17 12:00:19 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:00:19 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:00:19 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:00:19 user nova-compute[74261]:       <entry name="serial">7c9b0f63-db8b-4314-b916-56e9dc65b675</entry>
Oct 17 12:00:19 user nova-compute[74261]:       <entry name="uuid">7c9b0f63-db8b-4314-b916-56e9dc65b675</entry>
Oct 17 12:00:19 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:00:19 user nova-compute[74261]:     </system>
Oct 17 12:00:19 user nova-compute[74261]:   </sysinfo>
Oct 17 12:00:19 user nova-compute[74261]:   <os>
Oct 17 12:00:19 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:00:19 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:00:19 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:00:19 user nova-compute[74261]:   </os>
Oct 17 12:00:19 user nova-compute[74261]:   <features>
Oct 17 12:00:19 user nova-compute[74261]:     <acpi/>
Oct 17 12:00:19 user nova-compute[74261]:     <apic/>
Oct 17 12:00:19 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:00:19 user nova-compute[74261]:   </features>
Oct 17 12:00:19 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:00:19 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:00:19 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:00:19 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:00:19 user nova-compute[74261]:   </clock>
Oct 17 12:00:19 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:00:19 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:00:19 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:00:19 user nova-compute[74261]:   </cpu>
Oct 17 12:00:19 user nova-compute[74261]:   <devices>
Oct 17 12:00:19 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:00:19 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:00:19 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk"/>
Oct 17 12:00:19 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:00:19 user nova-compute[74261]:     </disk>
Oct 17 12:00:19 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:00:19 user nova-compute[74261]:       <mac address="fa:16:3e:fb:4d:b3"/>
Oct 17 12:00:19 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:00:19 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:00:19 user nova-compute[74261]:       <target dev="tapd4b27ad8-3d"/>
Oct 17 12:00:19 user nova-compute[74261]:     </interface>
Oct 17 12:00:19 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:00:19 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/console.log" append="off"/>
Oct 17 12:00:19 user nova-compute[74261]:     </serial>
Oct 17 12:00:19 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:00:19 user nova-compute[74261]:     <video>
Oct 17 12:00:19 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:00:19 user nova-compute[74261]:     </video>
Oct 17 12:00:19 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:00:19 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:00:19 user nova-compute[74261]:     </rng>
Oct 17 12:00:19 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:00:19 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:00:19 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:00:19 user nova-compute[74261]:     </memballoon>
Oct 17 12:00:19 user nova-compute[74261]:   </devices>
Oct 17 12:00:19 user nova-compute[74261]: </domain>
Oct 17 12:00:19 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-150427143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-150427143',id=34,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWjS+gY4aAH9DctNbNzzJABZRomTsctDrQNMZiAmKKGFO/0jB+KMeJj9hXxFhroWX9C3bLFdBngA195hhAZPaDKEeJsnclim8fbwnLrI7vYLQmzIs98EGg0g/n1Top0Yg==',key_name='tempest-keypair-817985384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-ua1yvbj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=7c9b0f63-db8b-4314-b916-56e9dc65b675,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG os_vif [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc9afa0b-bed5-55f4-9c18-b0b0b86e65bb', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4b27ad8-3d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4b27ad8-3d, col_values=(('qos', UUID('ef5ac85b-ef9d-40ec-b939-2d09edccd70e')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4b27ad8-3d, col_values=(('external_ids', {'iface-id': 'd4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:4d:b3', 'vm-uuid': '7c9b0f63-db8b-4314-b916-56e9dc65b675'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:19 user nova-compute[74261]: INFO os_vif [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d')
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:00:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No VIF found with MAC fa:16:3e:fb:4d:b3, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:00:20 user nova-compute[74261]: DEBUG nova.network.neutron [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updated VIF entry in instance network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:00:20 user nova-compute[74261]: DEBUG nova.network.neutron [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:00:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e06feab4-42d0-41bd-b22f-55283c905152 req-08aaa6a7-db77-46c8-94fe-dba6f97081b7 service nova] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-a3be502d-46ae-4e18-9cad-0ecfcba26f7c req-1f4a6cbf-911c-41dd-8210-c0bc5f598cab service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a3be502d-46ae-4e18-9cad-0ecfcba26f7c req-1f4a6cbf-911c-41dd-8210-c0bc5f598cab service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a3be502d-46ae-4e18-9cad-0ecfcba26f7c req-1f4a6cbf-911c-41dd-8210-c0bc5f598cab service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a3be502d-46ae-4e18-9cad-0ecfcba26f7c req-1f4a6cbf-911c-41dd-8210-c0bc5f598cab service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-a3be502d-46ae-4e18-9cad-0ecfcba26f7c req-1f4a6cbf-911c-41dd-8210-c0bc5f598cab service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:00:21 user nova-compute[74261]: WARNING nova.compute.manager [req-a3be502d-46ae-4e18-9cad-0ecfcba26f7c req-1f4a6cbf-911c-41dd-8210-c0bc5f598cab service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state building and task_state spawning.
Oct 17 12:00:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-7f43d74a-5857-46d5-802d-5ac9b5eb54c1 req-a39c693a-7c99-409d-ac27-d2323b556358 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7f43d74a-5857-46d5-802d-5ac9b5eb54c1 req-a39c693a-7c99-409d-ac27-d2323b556358 service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7f43d74a-5857-46d5-802d-5ac9b5eb54c1 req-a39c693a-7c99-409d-ac27-d2323b556358 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7f43d74a-5857-46d5-802d-5ac9b5eb54c1 req-a39c693a-7c99-409d-ac27-d2323b556358 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-7f43d74a-5857-46d5-802d-5ac9b5eb54c1 req-a39c693a-7c99-409d-ac27-d2323b556358 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:00:23 user nova-compute[74261]: WARNING nova.compute.manager [req-7f43d74a-5857-46d5-802d-5ac9b5eb54c1 req-a39c693a-7c99-409d-ac27-d2323b556358 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state building and task_state spawning.
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:00:23 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance spawned successfully.
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:00:23 user nova-compute[74261]: INFO nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 17 12:00:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:00:23 user nova-compute[74261]: INFO nova.compute.manager [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Took 6.88 seconds to build instance.
Oct 17 12:00:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0bf35854-7a71-4772-bab9-fc03570e4b2b tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.021s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:36 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 is timed out.
Oct 17 12:00:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully detached device vdb from instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 from the live domain config.
Oct 17 12:00:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTBwkVXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:00:36 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8736ea1b-01cb-4348-abfb-a723d6f74e8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:00:36 user nova-compute[74261]: No targets found.
Oct 17 12:00:36 user nova-compute[74261]: iSNS:
Oct 17 12:00:36 user nova-compute[74261]: No targets found.
Oct 17 12:00:36 user nova-compute[74261]: STATIC:
Oct 17 12:00:36 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 12:00:36 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:00:36 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:00:36 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f
Oct 17 12:00:36 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:00:36 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:00:36 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16
Oct 17 12:00:36 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:00:36 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:00:36 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:00:36 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:00:36 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:00:36 user nova-compute[74261]: FIRMWARE:
Oct 17 12:00:36 user nova-compute[74261]: No targets found.
Oct 17 12:00:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:00:36 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:00:36 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb4aa4-aa21-45d2-b4ee-19c10907e9ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b89e4fa-3328-46d1-b9c6-e1ba642be9bb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:00:36 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 12:00:36 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:00:36 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:00:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:00:36 user nova-compute[74261]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f (non-flash)
Oct 17 12:00:36 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:00:36 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:00:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b241afc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f'): ({'sdf'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Removing single pathed devices sdf {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72455bd-f5c4-49e7-a0c9-7cf529317c3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3575ece-d303-49a2-9437-663360ea4378]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Flushing IO for device /dev/sdf {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[941e5ccb-e184-4b43-81d1-4692ee3512fa]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[604d07e7-636e-4b1c-ab2b-142b84220267]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7cf233-743c-4570-9c58-c0068507bb89]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d35913c-fd20-4ac0-a2a8-77214204cc54]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260]
Oct 17 12:00:37 user nova-compute[74261]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f, portal: 172.16.0.220,3260] successful.
Oct 17 12:00:37 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838adc28-bd04-4537-b244-ca94b926950f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb5c22-7ab9-4ac9-b191-147727964b74]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] <== disconnect_volume: return (346ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:00:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:00:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'flavor' on Instance uuid 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:00:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-46291d36-4f3f-4127-8492-2db6f8b2d35d tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid f0f6a950-d984-4ece-9a20-134bf800db37 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 33e3905d-6e09-4b49-b1fe-deff0d677b1e {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid a4628ad3-6edb-4038-bba4-05421317e568 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "7d774988-6ac5-4701-a34e-64b99df1687e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f9098343-8120-48b2-848b-2807bb60eb73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a4628ad3-6edb-4038-bba4-05421317e568" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "7d774988-6ac5-4701-a34e-64b99df1687e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "f9098343-8120-48b2-848b-2807bb60eb73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "a4628ad3-6edb-4038-bba4-05421317e568" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:00:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:00:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:01:01 user nova-compute[74261]: INFO nova.compute.manager [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] instance snapshotting
Oct 17 12:01:01 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Beginning live snapshot process
Oct 17 12:01:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:01 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.212s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp053ohtpv/8d727544ffc24af49869cad0892bd3cd.delta 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp053ohtpv/8d727544ffc24af49869cad0892bd3cd.delta 1073741824" returned: 0 in 0.052s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:02 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 12:01:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-changed-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Refreshing instance network info cache due to event network-changed-e1304226-7bae-46dc-a4a3-7bfd644292ec. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] Acquiring lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] Acquired lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Refreshing network info cache for port e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:01:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 12:01:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 12:01:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 12:01:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:03 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 12:01:03 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp053ohtpv/8d727544ffc24af49869cad0892bd3cd.delta /opt/stack/data/nova/instances/snapshots/tmp053ohtpv/8d727544ffc24af49869cad0892bd3cd {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp053ohtpv/8d727544ffc24af49869cad0892bd3cd.delta /opt/stack/data/nova/instances/snapshots/tmp053ohtpv/8d727544ffc24af49869cad0892bd3cd" returned: 0 in 0.444s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Snapshot extracted, beginning image upload
Oct 17 12:01:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Updated VIF entry in instance network info cache for port e1304226-7bae-46dc-a4a3-7bfd644292ec. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:01:04 user nova-compute[74261]: DEBUG nova.network.neutron [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Updating instance_info_cache with network_info: [{"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-99e00062-eff0-4e34-a6cf-30b0f8280ae5 req-45a84da2-b1c1-429c-8f9a-582fe64adec1 service nova] Releasing lock "refresh_cache-2ed15423-71da-4dba-aee0-c1eae1e1a83f" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:01:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:06 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:07 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Snapshot image upload complete
Oct 17 12:01:07 user nova-compute[74261]: INFO nova.compute.manager [None req-72fbf364-21c6-4c07-85cc-b91729d52ca1 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Took 6.24 seconds to snapshot the instance on the hypervisor.
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG nova.objects.instance [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:08 user nova-compute[74261]: INFO nova.compute.manager [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Attaching volume 006c8d65-8a19-45f7-a0c7-dbe1346a5c3b to /dev/vdb
Oct 17 12:01:08 user nova-compute[74261]: DEBUG os_brick.utils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d9341-850d-412c-8c95-368cb978664e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e6677d-4e8c-4f1f-966d-84ff18d9bdf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[094640f5-2dd6-402a-b3b5-4c8cae99e4f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cf66e0-3b7d-47a9-bc88-aa58b6f43424]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:01:08 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:01:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed73457a-05b3-4495-b13e-6562ca1f4a21]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG os_brick.utils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:01:08 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Updating existing volume attachment record: 7d8cc584-e278-44e1-a999-9eb03a35f477 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:01:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:01:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:09 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:01:09 user nova-compute[74261]: INFO nova.compute.claims [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Claim successful on node user
Oct 17 12:01:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:01:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.policy [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca990d4fdc5848e48bf42478cb180974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6920a3da331440ffbbd52d3c82f12ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:01:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Creating image(s)
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "/opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "/opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "/opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.227s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk 1073741824" returned: 0 in 0.158s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Successfully created port: 8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Cannot resize image /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Ensure instance console log exists: /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Successfully updated port: 8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquired lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:01:11 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-changed-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.compute.manager [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Refreshing instance network info cache due to event network-changed-8f4b571d-0d8b-4f45-86c0-6712b8e41b79. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] Acquiring lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.neutron [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updating instance_info_cache with network_info: [{"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Releasing lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Instance network_info: |[{"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] Acquired lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Refreshing network info cache for port 8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Start _get_guest_xml network_info=[{"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:01:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:01:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1049807',id=35,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfuKSLEx6ugB+5h0oN3g6F6jB4B4i0uWL+peH+YQUYdoMzh2hT7v9rUDUpTdo+TpxjJg4dUzgcYNeHz0KNgP1N/xlpP2FbF97tQsJs7L39OMRi20kKEASiobes6uNx/yQ==',key_name='tempest-keypair-797013615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6920a3da331440ffbbd52d3c82f12ca7',ramdisk_id='',reservation_id='r-6nf4on4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-958416770',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca990d4fdc5848e48bf42478cb180974',uuid=182b51fb-f06d-4f49-b16a-ace65fa621ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Converting VIF {"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.objects.instance [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lazy-loading 'pci_devices' on Instance uuid 182b51fb-f06d-4f49-b16a-ace65fa621ed {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:01:12 user nova-compute[74261]:   <uuid>182b51fb-f06d-4f49-b16a-ace65fa621ed</uuid>
Oct 17 12:01:12 user nova-compute[74261]:   <name>instance-00000023</name>
Oct 17 12:01:12 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:01:12 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:01:12 user nova-compute[74261]:   <metadata>
Oct 17 12:01:12 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:01:12 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:01:12 user nova-compute[74261]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364</nova:name>
Oct 17 12:01:12 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:01:12</nova:creationTime>
Oct 17 12:01:12 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:01:12 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:01:12 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:01:12 user nova-compute[74261]:       <nova:owner>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:user uuid="ca990d4fdc5848e48bf42478cb180974">tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member</nova:user>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:project uuid="6920a3da331440ffbbd52d3c82f12ca7">tempest-TestServerVolumeAttachScenarioOldVersion-958416770</nova:project>
Oct 17 12:01:12 user nova-compute[74261]:       </nova:owner>
Oct 17 12:01:12 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:01:12 user nova-compute[74261]:       <nova:ports>
Oct 17 12:01:12 user nova-compute[74261]:         <nova:port uuid="8f4b571d-0d8b-4f45-86c0-6712b8e41b79">
Oct 17 12:01:12 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 12:01:12 user nova-compute[74261]:         </nova:port>
Oct 17 12:01:12 user nova-compute[74261]:       </nova:ports>
Oct 17 12:01:12 user nova-compute[74261]:     </nova:instance>
Oct 17 12:01:12 user nova-compute[74261]:   </metadata>
Oct 17 12:01:12 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:01:12 user nova-compute[74261]:     <system>
Oct 17 12:01:12 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:01:12 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:01:12 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:01:12 user nova-compute[74261]:       <entry name="serial">182b51fb-f06d-4f49-b16a-ace65fa621ed</entry>
Oct 17 12:01:12 user nova-compute[74261]:       <entry name="uuid">182b51fb-f06d-4f49-b16a-ace65fa621ed</entry>
Oct 17 12:01:12 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:01:12 user nova-compute[74261]:     </system>
Oct 17 12:01:12 user nova-compute[74261]:   </sysinfo>
Oct 17 12:01:12 user nova-compute[74261]:   <os>
Oct 17 12:01:12 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:01:12 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:01:12 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:01:12 user nova-compute[74261]:   </os>
Oct 17 12:01:12 user nova-compute[74261]:   <features>
Oct 17 12:01:12 user nova-compute[74261]:     <acpi/>
Oct 17 12:01:12 user nova-compute[74261]:     <apic/>
Oct 17 12:01:12 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:01:12 user nova-compute[74261]:   </features>
Oct 17 12:01:12 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:01:12 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:01:12 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:01:12 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:01:12 user nova-compute[74261]:   </clock>
Oct 17 12:01:12 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:01:12 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:01:12 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:01:12 user nova-compute[74261]:   </cpu>
Oct 17 12:01:12 user nova-compute[74261]:   <devices>
Oct 17 12:01:12 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:01:12 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:01:12 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk"/>
Oct 17 12:01:12 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:01:12 user nova-compute[74261]:     </disk>
Oct 17 12:01:12 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:01:12 user nova-compute[74261]:       <mac address="fa:16:3e:f7:a0:ad"/>
Oct 17 12:01:12 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:01:12 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:01:12 user nova-compute[74261]:       <target dev="tap8f4b571d-0d"/>
Oct 17 12:01:12 user nova-compute[74261]:     </interface>
Oct 17 12:01:12 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:01:12 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/console.log" append="off"/>
Oct 17 12:01:12 user nova-compute[74261]:     </serial>
Oct 17 12:01:12 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:01:12 user nova-compute[74261]:     <video>
Oct 17 12:01:12 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:01:12 user nova-compute[74261]:     </video>
Oct 17 12:01:12 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:01:12 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:01:12 user nova-compute[74261]:     </rng>
Oct 17 12:01:12 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:01:12 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:01:12 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:01:12 user nova-compute[74261]:     </memballoon>
Oct 17 12:01:12 user nova-compute[74261]:   </devices>
Oct 17 12:01:12 user nova-compute[74261]: </domain>
Oct 17 12:01:12 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1049807',id=35,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfuKSLEx6ugB+5h0oN3g6F6jB4B4i0uWL+peH+YQUYdoMzh2hT7v9rUDUpTdo+TpxjJg4dUzgcYNeHz0KNgP1N/xlpP2FbF97tQsJs7L39OMRi20kKEASiobes6uNx/yQ==',key_name='tempest-keypair-797013615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6920a3da331440ffbbd52d3c82f12ca7',ramdisk_id='',reservation_id='r-6nf4on4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-958416770',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca990d4fdc5848e48bf42478cb180974',uuid=182b51fb-f06d-4f49-b16a-ace65fa621ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Converting VIF {"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG os_vif [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a3b92af-436d-593c-8b27-02465d210243', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f4b571d-0d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f4b571d-0d, col_values=(('qos', UUID('43df789d-ec85-41ba-9418-e02e449d85b0')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f4b571d-0d, col_values=(('external_ids', {'iface-id': '8f4b571d-0d8b-4f45-86c0-6712b8e41b79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:a0:ad', 'vm-uuid': '182b51fb-f06d-4f49-b16a-ace65fa621ed'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:12 user nova-compute[74261]: INFO os_vif [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d')
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] No VIF found with MAC fa:16:3e:f7:a0:ad, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updated VIF entry in instance network info cache for port 8f4b571d-0d8b-4f45-86c0-6712b8e41b79. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.network.neutron [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updating instance_info_cache with network_info: [{"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9fcb8a9a-1b76-46bc-a9e2-e59902a4afb5 req-8b0c7c8b-5e3e-43af-a0ca-1b0147f82d63 service nova] Releasing lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:01:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-629a83f3-bb0b-4a53-afab-0d59458a6417 req-9809e7bf-0c48-40d0-bd43-a00dfe515d2e service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-629a83f3-bb0b-4a53-afab-0d59458a6417 req-9809e7bf-0c48-40d0-bd43-a00dfe515d2e service nova] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-629a83f3-bb0b-4a53-afab-0d59458a6417 req-9809e7bf-0c48-40d0-bd43-a00dfe515d2e service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-629a83f3-bb0b-4a53-afab-0d59458a6417 req-9809e7bf-0c48-40d0-bd43-a00dfe515d2e service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-629a83f3-bb0b-4a53-afab-0d59458a6417 req-9809e7bf-0c48-40d0-bd43-a00dfe515d2e service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] No waiting events found dispatching network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:14 user nova-compute[74261]: WARNING nova.compute.manager [req-629a83f3-bb0b-4a53-afab-0d59458a6417 req-9809e7bf-0c48-40d0-bd43-a00dfe515d2e service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received unexpected event network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 for instance with vm_state building and task_state spawning.
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-78ea14c7-ed86-46fb-9b9f-a737f35b77db req-505d51ac-2667-4507-ae07-bc20e114b4c9 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-78ea14c7-ed86-46fb-9b9f-a737f35b77db req-505d51ac-2667-4507-ae07-bc20e114b4c9 service nova] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-78ea14c7-ed86-46fb-9b9f-a737f35b77db req-505d51ac-2667-4507-ae07-bc20e114b4c9 service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-78ea14c7-ed86-46fb-9b9f-a737f35b77db req-505d51ac-2667-4507-ae07-bc20e114b4c9 service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-78ea14c7-ed86-46fb-9b9f-a737f35b77db req-505d51ac-2667-4507-ae07-bc20e114b4c9 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] No waiting events found dispatching network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:17 user nova-compute[74261]: WARNING nova.compute.manager [req-78ea14c7-ed86-46fb-9b9f-a737f35b77db req-505d51ac-2667-4507-ae07-bc20e114b4c9 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received unexpected event network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 for instance with vm_state building and task_state spawning.
Oct 17 12:01:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Instance spawned successfully.
Oct 17 12:01:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:01:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7411MB free_disk=25.064250946044922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:17 user nova-compute[74261]: INFO nova.compute.manager [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Terminating instance
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:01:17 user nova-compute[74261]: INFO nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Took 6.76 seconds to spawn the instance on the hypervisor.
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7c9b0f63-db8b-4314-b916-56e9dc65b675 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 182b51fb-f06d-4f49-b16a-ace65fa621ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: INFO nova.compute.manager [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Took 7.76 seconds to build instance.
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bc597d49-682b-4189-aafc-4f938556aa28 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.913s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-e413c4e9-3e26-4954-91fc-5da7416731d0 req-ea36fdff-c8f2-4a76-bdfa-f1537e9cfe41 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e413c4e9-3e26-4954-91fc-5da7416731d0 req-ea36fdff-c8f2-4a76-bdfa-f1537e9cfe41 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e413c4e9-3e26-4954-91fc-5da7416731d0 req-ea36fdff-c8f2-4a76-bdfa-f1537e9cfe41 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e413c4e9-3e26-4954-91fc-5da7416731d0 req-ea36fdff-c8f2-4a76-bdfa-f1537e9cfe41 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-e413c4e9-3e26-4954-91fc-5da7416731d0 req-ea36fdff-c8f2-4a76-bdfa-f1537e9cfe41 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-e413c4e9-3e26-4954-91fc-5da7416731d0 req-ea36fdff-c8f2-4a76-bdfa-f1537e9cfe41 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.860s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Instance destroyed successfully.
Oct 17 12:01:18 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lazy-loading 'resources' on Instance uuid 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1021692532',display_name='tempest-TestMinimumBasicScenario-server-1021692532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1021692532',id=28,image_ref='fdd8e827-6442-4a0e-b7aa-1c38e77c33f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+x632UK8Bx98rF8khzFSq+G9r8o4AXDsniYS/ck5lmJ2wPRvS4nPptWjM1CxsFzn65j2oUqHBbSC4t3C1Q3PU/HH85lPfc9rZ7hqDDuOQvig+3YfzrW3dZkmVgRfheg==',key_name='tempest-TestMinimumBasicScenario-307899441',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0813d99c95c47adb2b92394341409e8',ramdisk_id='',reservation_id='r-0ryi7bhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fdd8e827-6442-4a0e-b7aa-1c38e77c33f2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1183526091',owner_user_name='tempest-TestMinimumBasicScenario-1183526091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:58:30Z,user_data=None,user_id='4bfbfaa0fb2f4f7fbcdd7f8b98d784f9',uuid=76352fb0-a0b9-4b4b-b00e-b7878cdd4725,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converting VIF {"id": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "address": "fa:16:3e:86:e0:fe", "network": {"id": "940be06f-f2dd-40e0-9afe-70b5b08b3c69", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1052853376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0813d99c95c47adb2b92394341409e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a735cf-02", "ovs_interfaceid": "70a735cf-0293-43f6-8fcb-8bd26aa5d779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG os_vif [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70a735cf-02, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e2d2295-c6df-4fe3-9ea3-f902abfd2f2b) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:01:18 user nova-compute[74261]: INFO os_vif [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=70a735cf-0293-43f6-8fcb-8bd26aa5d779,network=Network(940be06f-f2dd-40e0-9afe-70b5b08b3c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a735cf-02')
Oct 17 12:01:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Deleting instance files /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725_del
Oct 17 12:01:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Deletion of /opt/stack/data/nova/instances/76352fb0-a0b9-4b4b-b00e-b7878cdd4725_del complete
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: INFO nova.compute.manager [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 17 12:01:18 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:19 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Took 1.24 seconds to deallocate network for instance.
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-90a39ba9-2b9c-4033-8f2f-c65f5784baf2 req-29fa02ab-5b71-41e5-a700-8b49057497c5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-deleted-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:19 user nova-compute[74261]: INFO nova.compute.manager [req-90a39ba9-2b9c-4033-8f2f-c65f5784baf2 req-29fa02ab-5b71-41e5-a700-8b49057497c5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Neutron deleted interface 70a735cf-0293-43f6-8fcb-8bd26aa5d779; detaching it from the instance and deleting it from the info cache
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.network.neutron [req-90a39ba9-2b9c-4033-8f2f-c65f5784baf2 req-29fa02ab-5b71-41e5-a700-8b49057497c5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-90a39ba9-2b9c-4033-8f2f-c65f5784baf2 req-29fa02ab-5b71-41e5-a700-8b49057497c5 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Detach interface failed, port_id=70a735cf-0293-43f6-8fcb-8bd26aa5d779, reason: Instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:19 user nova-compute[74261]: WARNING nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state deleted and task_state None.
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:19 user nova-compute[74261]: WARNING nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state deleted and task_state None.
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:19 user nova-compute[74261]: WARNING nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state deleted and task_state None.
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:19 user nova-compute[74261]: WARNING nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-unplugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state deleted and task_state None.
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Acquiring lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] No waiting events found dispatching network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:19 user nova-compute[74261]: WARNING nova.compute.manager [req-701d6536-fb8a-46c5-83e1-55cb4861c63a req-30d778fd-4633-4aa6-b020-1ae68c6ab8e0 service nova] [instance: 76352fb0-a0b9-4b4b-b00e-b7878cdd4725] Received unexpected event network-vif-plugged-70a735cf-0293-43f6-8fcb-8bd26aa5d779 for instance with vm_state deleted and task_state None.
Oct 17 12:01:20 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:01:20 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:01:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:20 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Deleted allocations for instance 76352fb0-a0b9-4b4b-b00e-b7878cdd4725
Oct 17 12:01:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ded88939-0c15-4f98-bce9-53932239ae82 tempest-TestMinimumBasicScenario-1183526091 tempest-TestMinimumBasicScenario-1183526091-project-member] Lock "76352fb0-a0b9-4b4b-b00e-b7878cdd4725" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.096s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJoYLlqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:01:28 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:01:28 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:01:28 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9510171-7e8f-4a63-88eb-b23c03fd7290]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:01:28 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b6bde-ef44-495c-b329-13917586de91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b] added
Oct 17 12:01:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b863b4e2-5654-4bdc-b11b-85802ff9a961]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf21df7a-3a35-4674-8567-dc9fcf70f98f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJoYLlqc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJoYLlqc" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf39b2-857b-4f40-b8cc-87c18ed35000]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJoYLlqc'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b192cb-e61b-4646-aae0-7a761db10806]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b1139-7e83-4893-9bff-99b57a710b08]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f950338-d54a-4baa-9e14-43cc1d4cf210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260]
Oct 17 12:01:28 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260] successful.
Oct 17 12:01:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860da87-aba9-4b48-9f45-f6a3b13e834e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1c140-ca4c-4b34-82ca-1fcef458b965]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b (non-flash)
Oct 17 12:01:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:01:28 user nova-compute[74261]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b (non-flash)
Oct 17 12:01:28 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.067s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b12294e-29ff-4b29-bfbf-2d0dfecb4d62]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:28 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJoYLlqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23364653536633162', 'path': '/dev/sdd'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364653536633162', 'path': '/dev/sdd'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG nova.objects.instance [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:01:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:01:29 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:01:29 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 12:01:29 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:01:29 user nova-compute[74261]:   <serial>006c8d65-8a19-45f7-a0c7-dbe1346a5c3b</serial>
Oct 17 12:01:29 user nova-compute[74261]: </disk>
Oct 17 12:01:29 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:01:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:01:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:01:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] No VIF found with MAC fa:16:3e:ac:11:df, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:01:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-016784dd-e1e1-4ab9-bf53-f5d03136acef tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.678s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:30 user nova-compute[74261]: INFO nova.compute.manager [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Detaching volume 006c8d65-8a19-45f7-a0c7-dbe1346a5c3b
Oct 17 12:01:30 user nova-compute[74261]: INFO nova.virt.block_device [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Attempting to driver detach volume 006c8d65-8a19-45f7-a0c7-dbe1346a5c3b from mountpoint /dev/vdb
Oct 17 12:01:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Attempting to detach device vdb from instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:01:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:01:31 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:01:31 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 12:01:31 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:01:31 user nova-compute[74261]:   <serial>006c8d65-8a19-45f7-a0c7-dbe1346a5c3b</serial>
Oct 17 12:01:31 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:01:31 user nova-compute[74261]: </disk>
Oct 17 12:01:31 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:01:31 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully detached device vdb from instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f from the persistent domain config.
Oct 17 12:01:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:01:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:01:31 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:01:31 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 12:01:31 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:01:31 user nova-compute[74261]:   <serial>006c8d65-8a19-45f7-a0c7-dbe1346a5c3b</serial>
Oct 17 12:01:31 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:01:31 user nova-compute[74261]: </disk>
Oct 17 12:01:31 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:01:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:01:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:51 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f is timed out.
Oct 17 12:01:51 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully detached device vdb from instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f from the live domain config.
Oct 17 12:01:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJoYLlqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:01:51 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d875c-0cc8-4adc-bc41-344b2223e187]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:01:51 user nova-compute[74261]: No targets found.
Oct 17 12:01:51 user nova-compute[74261]: iSNS:
Oct 17 12:01:51 user nova-compute[74261]: No targets found.
Oct 17 12:01:51 user nova-compute[74261]: STATIC:
Oct 17 12:01:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 12:01:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:01:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:01:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16
Oct 17 12:01:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:01:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:01:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b
Oct 17 12:01:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:01:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:01:51 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:01:51 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:01:51 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:01:51 user nova-compute[74261]: FIRMWARE:
Oct 17 12:01:51 user nova-compute[74261]: No targets found.
Oct 17 12:01:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:01:51 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:01:51 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0af4fbd-7f09-401b-9b7e-773a326aa433]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c55374-740a-44e5-a17a-b40153a2281a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:01:51 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:01:51 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:01:51 user nova-compute[74261]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b (non-flash)
Oct 17 12:01:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:01:51 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:01:51 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:01:51 user nova-compute[74261]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b (non-flash)
Oct 17 12:01:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c105e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b'): ({'sdd'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Removing single pathed devices sdd {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7c69b-63e3-45c8-869f-6554981482c1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dbf8ff-3f25-4d1d-a9e5-e4372d49134d]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Flushing IO for device /dev/sdd {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab48658f-b2f0-41c4-8ce3-f85161bdcdd9]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae091fd-282c-4b4e-8fd6-bcafe3458c88]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a88e07-5a86-48d7-a879-04a234e00a7b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f29c1-0133-4b3d-8f8e-852a118af39e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260]
Oct 17 12:01:51 user nova-compute[74261]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b, portal: 172.16.0.220,3260] successful.
Oct 17 12:01:51 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006c8d65-8a19-45f7-a0c7-dbe1346a5c3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9d57c-93da-4698-9b83-27c4e39edf08]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] <== disconnect_volume: return (310ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:01:51 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:01:52 user nova-compute[74261]: INFO nova.compute.manager [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Unrescuing
Oct 17 12:01:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'flavor' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'flavor' on Instance uuid 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:01:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8803e343-6222-42f8-92e2-516655ca4f97 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-a4c49a56-5508-462e-b07c-c91355d8c59f req-22eb77ba-5dd7-46ea-bb60-eef78261f8e0 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a4c49a56-5508-462e-b07c-c91355d8c59f req-22eb77ba-5dd7-46ea-bb60-eef78261f8e0 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a4c49a56-5508-462e-b07c-c91355d8c59f req-22eb77ba-5dd7-46ea-bb60-eef78261f8e0 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a4c49a56-5508-462e-b07c-c91355d8c59f req-22eb77ba-5dd7-46ea-bb60-eef78261f8e0 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-a4c49a56-5508-462e-b07c-c91355d8c59f req-22eb77ba-5dd7-46ea-bb60-eef78261f8e0 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:53 user nova-compute[74261]: WARNING nova.compute.manager [req-a4c49a56-5508-462e-b07c-c91355d8c59f req-22eb77ba-5dd7-46ea-bb60-eef78261f8e0 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state rescued and task_state unrescuing.
Oct 17 12:01:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance destroyed successfully.
Oct 17 12:01:54 user nova-compute[74261]: INFO nova.compute.manager [None req-d64821fa-3086-40e1-aeb6-e63349068666 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Get console output
Oct 17 12:01:54 user nova-compute[74261]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 17 12:01:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:55 user nova-compute[74261]: WARNING nova.compute.manager [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state rescued and task_state unrescuing.
Oct 17 12:01:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:55 user nova-compute[74261]: WARNING nova.compute.manager [req-c6547deb-7368-4886-8c04-71f1295d3c88 req-609e7db5-bca5-42bd-bb37-a62cad937da9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state rescued and task_state unrescuing.
Oct 17 12:01:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:01:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-59fff8d2-7801-411b-8771-acd4752431ba tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:01:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a16656e-75fa-4000-b718-003a5228c82a req-2c770e69-7bad-4fab-9b8c-525e33ed37c7 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:01:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a16656e-75fa-4000-b718-003a5228c82a req-2c770e69-7bad-4fab-9b8c-525e33ed37c7 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:01:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a16656e-75fa-4000-b718-003a5228c82a req-2c770e69-7bad-4fab-9b8c-525e33ed37c7 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:01:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7a16656e-75fa-4000-b718-003a5228c82a req-2c770e69-7bad-4fab-9b8c-525e33ed37c7 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:01:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a16656e-75fa-4000-b718-003a5228c82a req-2c770e69-7bad-4fab-9b8c-525e33ed37c7 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:01:57 user nova-compute[74261]: WARNING nova.compute.manager [req-7a16656e-75fa-4000-b718-003a5228c82a req-2c770e69-7bad-4fab-9b8c-525e33ed37c7 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state active and task_state None.
Oct 17 12:01:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:02:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:02:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:02:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing instance network info cache due to event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:02:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:02:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:02:07 user nova-compute[74261]: DEBUG nova.network.neutron [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:02:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updated VIF entry in instance network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:02:08 user nova-compute[74261]: DEBUG nova.network.neutron [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c504aa5a-42ee-42ca-b8f0-4631d9b7afe5 req-df6412ed-4c57-4e42-b13e-f9d4d533321c service nova] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:02:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:02:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=25.09933853149414GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:15 user nova-compute[74261]: INFO nova.compute.manager [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Shelving
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7c9b0f63-db8b-4314-b916-56e9dc65b675 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 182b51fb-f06d-4f49-b16a-ace65fa621ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-b4969118-15e3-4d91-a514-ee1556934ba8 req-4adeb461-c60c-4ea2-ba73-d4591bfe29d3 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-unplugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b4969118-15e3-4d91-a514-ee1556934ba8 req-4adeb461-c60c-4ea2-ba73-d4591bfe29d3 service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b4969118-15e3-4d91-a514-ee1556934ba8 req-4adeb461-c60c-4ea2-ba73-d4591bfe29d3 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b4969118-15e3-4d91-a514-ee1556934ba8 req-4adeb461-c60c-4ea2-ba73-d4591bfe29d3 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-b4969118-15e3-4d91-a514-ee1556934ba8 req-4adeb461-c60c-4ea2-ba73-d4591bfe29d3 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-unplugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:15 user nova-compute[74261]: WARNING nova.compute.manager [req-b4969118-15e3-4d91-a514-ee1556934ba8 req-4adeb461-c60c-4ea2-ba73-d4591bfe29d3 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-unplugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state active and task_state shelving.
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:02:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.771s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance destroyed successfully.
Oct 17 12:02:16 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Beginning cold snapshot process
Oct 17 12:02:16 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 12:02:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk /opt/stack/data/nova/instances/snapshots/tmp2z_s6992/7f46703373f64629b14c0c6cf6b754b2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk /opt/stack/data/nova/instances/snapshots/tmp2z_s6992/7f46703373f64629b14c0c6cf6b754b2" returned: 0 in 1.117s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:17 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Snapshot extracted, beginning image upload
Oct 17 12:02:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-a63aaa89-e844-4bcf-ba20-e4d758d0ee57 req-92709b44-a290-48fa-a689-48e751e29101 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a63aaa89-e844-4bcf-ba20-e4d758d0ee57 req-92709b44-a290-48fa-a689-48e751e29101 service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a63aaa89-e844-4bcf-ba20-e4d758d0ee57 req-92709b44-a290-48fa-a689-48e751e29101 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a63aaa89-e844-4bcf-ba20-e4d758d0ee57 req-92709b44-a290-48fa-a689-48e751e29101 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-a63aaa89-e844-4bcf-ba20-e4d758d0ee57 req-92709b44-a290-48fa-a689-48e751e29101 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:17 user nova-compute[74261]: WARNING nova.compute.manager [req-a63aaa89-e844-4bcf-ba20-e4d758d0ee57 req-92709b44-a290-48fa-a689-48e751e29101 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state active and task_state shelving_image_uploading.
Oct 17 12:02:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:02:20 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Snapshot image upload complete
Oct 17 12:02:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:02:20 user nova-compute[74261]: INFO nova.compute.manager [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Shelve offloading
Oct 17 12:02:20 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance destroyed successfully.
Oct 17 12:02:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:02:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:02:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:02:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:02:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:21 user nova-compute[74261]: INFO nova.compute.manager [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Terminating instance
Oct 17 12:02:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-43ca01dd-e38c-4bd7-bfed-8edbdd836a3d req-a25e955c-45df-419f-a1e7-166e03193c06 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-unplugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-43ca01dd-e38c-4bd7-bfed-8edbdd836a3d req-a25e955c-45df-419f-a1e7-166e03193c06 service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-43ca01dd-e38c-4bd7-bfed-8edbdd836a3d req-a25e955c-45df-419f-a1e7-166e03193c06 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-43ca01dd-e38c-4bd7-bfed-8edbdd836a3d req-a25e955c-45df-419f-a1e7-166e03193c06 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-43ca01dd-e38c-4bd7-bfed-8edbdd836a3d req-a25e955c-45df-419f-a1e7-166e03193c06 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-unplugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-43ca01dd-e38c-4bd7-bfed-8edbdd836a3d req-a25e955c-45df-419f-a1e7-166e03193c06 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-unplugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance destroyed successfully.
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'resources' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-150427143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-150427143',id=34,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWjS+gY4aAH9DctNbNzzJABZRomTsctDrQNMZiAmKKGFO/0jB+KMeJj9hXxFhroWX9C3bLFdBngA195hhAZPaDKEeJsnclim8fbwnLrI7vYLQmzIs98EGg0g/n1Top0Yg==',key_name='tempest-keypair-817985384',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-ua1yvbj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member',shelved_at='2023-10-17T12:02:20.038261',shelved_host='user',shelved_image_id='b890e6ae-9223-4351-a84e-71e3b986d0b7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=7c9b0f63-db8b-4314-b916-56e9dc65b675,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG os_vif [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4b27ad8-3d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef5ac85b-ef9d-40ec-b939-2d09edccd70e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: INFO os_vif [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d')
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Deleting instance files /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675_del
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Deletion of /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675_del complete
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing instance network info cache due to event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.neutron [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Deleted allocations for instance 7c9b0f63-db8b-4314-b916-56e9dc65b675
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.objects.base [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<7c9b0f63-db8b-4314-b916-56e9dc65b675> lazy-loaded attributes: resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Instance destroyed successfully.
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.objects.instance [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lazy-loading 'resources' on Instance uuid 2ed15423-71da-4dba-aee0-c1eae1e1a83f {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2057197925',display_name='tempest-AttachVolumeNegativeTest-server-2057197925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2057197925',id=33,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp0Ztoxr2JQes2Ey2/8/FxABwrasci91lWdngLu4wC14tHqXTu1anpY3kSibPkYXElAv1eATPbbbJa1YxaG8OZLiWJreY6L/X4rWR64J+kkkyImMpKjt968CTKnGXmpSA==',key_name='tempest-keypair-558657562',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2fe4687b8ef41248f726f6ddd948216',ramdisk_id='',reservation_id='r-u500hg8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1274994880',owner_user_name='tempest-AttachVolumeNegativeTest-1274994880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='126186127bc44a85ac39bb6bfbb0b8c6',uuid=2ed15423-71da-4dba-aee0-c1eae1e1a83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converting VIF {"id": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "address": "fa:16:3e:ac:11:df", "network": {"id": "e49d278e-8e55-44db-b622-9ee3ba59de57", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1642839749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2fe4687b8ef41248f726f6ddd948216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1304226-7b", "ovs_interfaceid": "e1304226-7bae-46dc-a4a3-7bfd644292ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG os_vif [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1304226-7b, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09053d52-ca3b-4349-a930-ca25a5c8e605) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:22 user nova-compute[74261]: INFO os_vif [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:11:df,bridge_name='br-int',has_traffic_filtering=True,id=e1304226-7bae-46dc-a4a3-7bfd644292ec,network=Network(e49d278e-8e55-44db-b622-9ee3ba59de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1304226-7b')
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Deleting instance files /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f_del
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Deletion of /opt/stack/data/nova/instances/2ed15423-71da-4dba-aee0-c1eae1e1a83f_del complete
Oct 17 12:02:22 user nova-compute[74261]: INFO nova.compute.manager [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.neutron [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updated VIF entry in instance network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.network.neutron [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5440efcf-3eb6-48de-a46a-02404bd1ea27 req-012ed582-b838-4dda-9910-6310abdb3c21 service nova] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a60315b1-2e12-40ea-b275-d2284a6a4e41 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.789s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:24 user nova-compute[74261]: WARNING nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received unexpected event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with vm_state active and task_state deleting.
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:24 user nova-compute[74261]: WARNING nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received unexpected event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with vm_state active and task_state deleting.
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:24 user nova-compute[74261]: WARNING nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received unexpected event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with vm_state active and task_state deleting.
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-unplugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-unplugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-unplugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Acquiring lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] No waiting events found dispatching network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:24 user nova-compute[74261]: WARNING nova.compute.manager [req-dc359f15-1d8d-4833-8315-c458f5fdb6f9 req-f50c5a94-a77d-4fd2-9f8c-5ca8c4c61368 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received unexpected event network-vif-plugged-e1304226-7bae-46dc-a4a3-7bfd644292ec for instance with vm_state active and task_state deleting.
Oct 17 12:02:24 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Took 1.44 seconds to deallocate network for instance.
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:24 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Deleted allocations for instance 2ed15423-71da-4dba-aee0-c1eae1e1a83f
Oct 17 12:02:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-92747d2c-978a-42d1-9bb6-19806b0e9983 tempest-AttachVolumeNegativeTest-1274994880 tempest-AttachVolumeNegativeTest-1274994880-project-member] Lock "2ed15423-71da-4dba-aee0-c1eae1e1a83f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.348s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-e76f1f0a-d44f-45c6-9662-bd095d1cbba6 req-7bd7f56f-45d2-4c1a-accd-d02346ccc527 service nova] [instance: 2ed15423-71da-4dba-aee0-c1eae1e1a83f] Received event network-vif-deleted-e1304226-7bae-46dc-a4a3-7bfd644292ec {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:02:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:32 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:02:32 user nova-compute[74261]: INFO nova.compute.claims [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Claim successful on node user
Oct 17 12:02:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:02:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.policy [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbe9e65516294671becfcf323392c5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa52739dfc46c3bfa4228ef33818ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:02:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Creating image(s)
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "/opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "/opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "/opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.166s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk 1073741824" returned: 0 in 0.059s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Successfully created port: e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.214s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:02:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Cannot resize image /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Ensure instance console log exists: /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Successfully updated port: e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "refresh_cache-36bc1d33-3e18-4c25-94b2-f8d25f977a28" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquired lock "refresh_cache-36bc1d33-3e18-4c25-94b2-f8d25f977a28" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-changed-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Refreshing instance network info cache due to event network-changed-e10e006f-d1d8-4f25-8395-c7b95d479c8f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] Acquiring lock "refresh_cache-36bc1d33-3e18-4c25-94b2-f8d25f977a28" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Updating instance_info_cache with network_info: [{"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Releasing lock "refresh_cache-36bc1d33-3e18-4c25-94b2-f8d25f977a28" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Instance network_info: |[{"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] Acquired lock "refresh_cache-36bc1d33-3e18-4c25-94b2-f8d25f977a28" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.neutron [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Refreshing network info cache for port e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Start _get_guest_xml network_info=[{"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:02:34 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:02:34 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-546513809',display_name='tempest-VolumesActionsTest-instance-546513809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-546513809',id=36,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7caa52739dfc46c3bfa4228ef33818ba',ramdisk_id='',reservation_id='r-ftzk0o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1154658100',owner_user_name='tempest-VolumesActionsTest-1154658100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:02:33Z,user_data=None,user_id='cbe9e65516294671becfcf323392c5dc',uuid=36bc1d33-3e18-4c25-94b2-f8d25f977a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Converting VIF {"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lazy-loading 'pci_devices' on Instance uuid 36bc1d33-3e18-4c25-94b2-f8d25f977a28 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:02:34 user nova-compute[74261]:   <uuid>36bc1d33-3e18-4c25-94b2-f8d25f977a28</uuid>
Oct 17 12:02:34 user nova-compute[74261]:   <name>instance-00000024</name>
Oct 17 12:02:34 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:02:34 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:02:34 user nova-compute[74261]:   <metadata>
Oct 17 12:02:34 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:02:34 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:02:34 user nova-compute[74261]:       <nova:name>tempest-VolumesActionsTest-instance-546513809</nova:name>
Oct 17 12:02:34 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:02:34</nova:creationTime>
Oct 17 12:02:34 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:02:34 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:02:34 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:02:34 user nova-compute[74261]:       <nova:owner>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:user uuid="cbe9e65516294671becfcf323392c5dc">tempest-VolumesActionsTest-1154658100-project-member</nova:user>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:project uuid="7caa52739dfc46c3bfa4228ef33818ba">tempest-VolumesActionsTest-1154658100</nova:project>
Oct 17 12:02:34 user nova-compute[74261]:       </nova:owner>
Oct 17 12:02:34 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:02:34 user nova-compute[74261]:       <nova:ports>
Oct 17 12:02:34 user nova-compute[74261]:         <nova:port uuid="e10e006f-d1d8-4f25-8395-c7b95d479c8f">
Oct 17 12:02:34 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 17 12:02:34 user nova-compute[74261]:         </nova:port>
Oct 17 12:02:34 user nova-compute[74261]:       </nova:ports>
Oct 17 12:02:34 user nova-compute[74261]:     </nova:instance>
Oct 17 12:02:34 user nova-compute[74261]:   </metadata>
Oct 17 12:02:34 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:02:34 user nova-compute[74261]:     <system>
Oct 17 12:02:34 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:02:34 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:02:34 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:02:34 user nova-compute[74261]:       <entry name="serial">36bc1d33-3e18-4c25-94b2-f8d25f977a28</entry>
Oct 17 12:02:34 user nova-compute[74261]:       <entry name="uuid">36bc1d33-3e18-4c25-94b2-f8d25f977a28</entry>
Oct 17 12:02:34 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:02:34 user nova-compute[74261]:     </system>
Oct 17 12:02:34 user nova-compute[74261]:   </sysinfo>
Oct 17 12:02:34 user nova-compute[74261]:   <os>
Oct 17 12:02:34 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:02:34 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:02:34 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:02:34 user nova-compute[74261]:   </os>
Oct 17 12:02:34 user nova-compute[74261]:   <features>
Oct 17 12:02:34 user nova-compute[74261]:     <acpi/>
Oct 17 12:02:34 user nova-compute[74261]:     <apic/>
Oct 17 12:02:34 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:02:34 user nova-compute[74261]:   </features>
Oct 17 12:02:34 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:02:34 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:02:34 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:02:34 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:02:34 user nova-compute[74261]:   </clock>
Oct 17 12:02:34 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:02:34 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:02:34 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:02:34 user nova-compute[74261]:   </cpu>
Oct 17 12:02:34 user nova-compute[74261]:   <devices>
Oct 17 12:02:34 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:02:34 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:02:34 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk"/>
Oct 17 12:02:34 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:02:34 user nova-compute[74261]:     </disk>
Oct 17 12:02:34 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:02:34 user nova-compute[74261]:       <mac address="fa:16:3e:06:41:1d"/>
Oct 17 12:02:34 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:02:34 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:02:34 user nova-compute[74261]:       <target dev="tape10e006f-d1"/>
Oct 17 12:02:34 user nova-compute[74261]:     </interface>
Oct 17 12:02:34 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:02:34 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/console.log" append="off"/>
Oct 17 12:02:34 user nova-compute[74261]:     </serial>
Oct 17 12:02:34 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:02:34 user nova-compute[74261]:     <video>
Oct 17 12:02:34 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:02:34 user nova-compute[74261]:     </video>
Oct 17 12:02:34 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:02:34 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:02:34 user nova-compute[74261]:     </rng>
Oct 17 12:02:34 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:02:34 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:02:34 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:02:34 user nova-compute[74261]:     </memballoon>
Oct 17 12:02:34 user nova-compute[74261]:   </devices>
Oct 17 12:02:34 user nova-compute[74261]: </domain>
Oct 17 12:02:34 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-546513809',display_name='tempest-VolumesActionsTest-instance-546513809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-546513809',id=36,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7caa52739dfc46c3bfa4228ef33818ba',ramdisk_id='',reservation_id='r-ftzk0o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1154658100',owner_user_name='tempest-VolumesActionsTest-1154658100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:02:33Z,user_data=None,user_id='cbe9e65516294671becfcf323392c5dc',uuid=36bc1d33-3e18-4c25-94b2-f8d25f977a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Converting VIF {"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG os_vif [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac84a70e-4ca1-5cf0-ac3a-9f29ee3fed89', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape10e006f-d1, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape10e006f-d1, col_values=(('qos', UUID('1b12c982-09a0-461a-bb61-f9e3761c759a')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape10e006f-d1, col_values=(('external_ids', {'iface-id': 'e10e006f-d1d8-4f25-8395-c7b95d479c8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:41:1d', 'vm-uuid': '36bc1d33-3e18-4c25-94b2-f8d25f977a28'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:34 user nova-compute[74261]: INFO os_vif [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1')
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:02:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] No VIF found with MAC fa:16:3e:06:41:1d, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:02:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Updated VIF entry in instance network info cache for port e10e006f-d1d8-4f25-8395-c7b95d479c8f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:02:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Updating instance_info_cache with network_info: [{"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-38ebad70-0b3f-4fdb-93df-4ab88fb8b0a4 req-2ccd43dc-47f7-4c7a-9bfa-faf1b6a55635 service nova] Releasing lock "refresh_cache-36bc1d33-3e18-4c25-94b2-f8d25f977a28" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-2c64dbf0-6be4-4856-8efa-9b7d93f21022 req-98c9f84e-92a5-4be3-b257-fdb0d948b360 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2c64dbf0-6be4-4856-8efa-9b7d93f21022 req-98c9f84e-92a5-4be3-b257-fdb0d948b360 service nova] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2c64dbf0-6be4-4856-8efa-9b7d93f21022 req-98c9f84e-92a5-4be3-b257-fdb0d948b360 service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2c64dbf0-6be4-4856-8efa-9b7d93f21022 req-98c9f84e-92a5-4be3-b257-fdb0d948b360 service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-2c64dbf0-6be4-4856-8efa-9b7d93f21022 req-98c9f84e-92a5-4be3-b257-fdb0d948b360 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] No waiting events found dispatching network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:36 user nova-compute[74261]: WARNING nova.compute.manager [req-2c64dbf0-6be4-4856-8efa-9b7d93f21022 req-98c9f84e-92a5-4be3-b257-fdb0d948b360 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received unexpected event network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f for instance with vm_state building and task_state spawning.
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-dbbedf8a-cba9-4684-bb90-0d11a303504b req-f4e1d807-637f-416b-8fcc-3df6f6579175 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dbbedf8a-cba9-4684-bb90-0d11a303504b req-f4e1d807-637f-416b-8fcc-3df6f6579175 service nova] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dbbedf8a-cba9-4684-bb90-0d11a303504b req-f4e1d807-637f-416b-8fcc-3df6f6579175 service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dbbedf8a-cba9-4684-bb90-0d11a303504b req-f4e1d807-637f-416b-8fcc-3df6f6579175 service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-dbbedf8a-cba9-4684-bb90-0d11a303504b req-f4e1d807-637f-416b-8fcc-3df6f6579175 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] No waiting events found dispatching network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:38 user nova-compute[74261]: WARNING nova.compute.manager [req-dbbedf8a-cba9-4684-bb90-0d11a303504b req-f4e1d807-637f-416b-8fcc-3df6f6579175 service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received unexpected event network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f for instance with vm_state building and task_state spawning.
Oct 17 12:02:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Instance spawned successfully.
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:02:38 user nova-compute[74261]: INFO nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 17 12:02:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:02:38 user nova-compute[74261]: INFO nova.compute.manager [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Took 6.30 seconds to build instance.
Oct 17 12:02:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c67fa481-1f01-43d5-a015-0418338f8971 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.399s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:02:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:02:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:02:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:02:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:55 user nova-compute[74261]: INFO nova.compute.manager [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Terminating instance
Oct 17 12:02:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-0e1824a2-7592-4531-a6e6-0c22244b75c3 req-1979156b-2974-4b85-826e-2be0d12cf277 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-unplugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0e1824a2-7592-4531-a6e6-0c22244b75c3 req-1979156b-2974-4b85-826e-2be0d12cf277 service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0e1824a2-7592-4531-a6e6-0c22244b75c3 req-1979156b-2974-4b85-826e-2be0d12cf277 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0e1824a2-7592-4531-a6e6-0c22244b75c3 req-1979156b-2974-4b85-826e-2be0d12cf277 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-0e1824a2-7592-4531-a6e6-0c22244b75c3 req-1979156b-2974-4b85-826e-2be0d12cf277 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-unplugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-0e1824a2-7592-4531-a6e6-0c22244b75c3 req-1979156b-2974-4b85-826e-2be0d12cf277 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-unplugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Instance destroyed successfully.
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'resources' on Instance uuid 33e3905d-6e09-4b49-b1fe-deff0d677b1e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-101703142',display_name='tempest-ServerActionsTestOtherA-server-101703142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-101703142',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:58:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-4d8tromd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=33e3905d-6e09-4b49-b1fe-deff0d677b1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "51ae7fa5-0161-409c-b261-552e0fc76030", "address": "fa:16:3e:5c:94:c7", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae7fa5-01", "ovs_interfaceid": "51ae7fa5-0161-409c-b261-552e0fc76030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_vif [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ae7fa5-01, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f873f26b-0d4d-4889-9faa-9c1f608eef73) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: INFO os_vif [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=51ae7fa5-0161-409c-b261-552e0fc76030,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae7fa5-01')
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjqrexZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:02:56 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b7b006-3094-4ff8-aa61-0640bf1405de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:02:56 user nova-compute[74261]: No targets found.
Oct 17 12:02:56 user nova-compute[74261]: iSNS:
Oct 17 12:02:56 user nova-compute[74261]: No targets found.
Oct 17 12:02:56 user nova-compute[74261]: STATIC:
Oct 17 12:02:56 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9
Oct 17 12:02:56 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:02:56 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:02:56 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16
Oct 17 12:02:56 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:02:56 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:02:56 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:02:56 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:02:56 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:02:56 user nova-compute[74261]: FIRMWARE:
Oct 17 12:02:56 user nova-compute[74261]: No targets found.
Oct 17 12:02:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:02:56 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:02:56 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9ef82-6f2b-4ee6-86ed-2dba74bed3a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daea146-346a-434d-bf63-56d9fa222860]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:02:56 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:02:56 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:02:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:02:56 user nova-compute[74261]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 (non-flash)
Oct 17 12:02:56 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:02:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b2c1024d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9'): ({'sdg'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Removing single pathed devices sdg {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[12149aa0-0345-45f4-b50e-19a7665cabfc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc101314-d78d-43c5-8cb3-9c9d80055297]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Flushing IO for device /dev/sdg {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9c9f7b-664f-45e5-8859-90ab93b046b0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96fe00-e67d-4e1e-91ab-41f48e4dfd51]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] SCSI volumes sdg have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dbdb6b-b016-4ea0-9050-45dbd79cc09e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec100d9-ffad-49a2-8e73-4c8c5bc9581c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260]
Oct 17 12:02:56 user nova-compute[74261]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9, portal: 172.16.0.220,3260] successful.
Oct 17 12:02:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9822d0e-a521-405d-9f3f-82ea5a209ca9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc18e8-b369-42fd-96c5-24972fc02827]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] <== disconnect_volume: return (297ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:02:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Deleting instance files /opt/stack/data/nova/instances/33e3905d-6e09-4b49-b1fe-deff0d677b1e_del
Oct 17 12:02:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Deletion of /opt/stack/data/nova/instances/33e3905d-6e09-4b49-b1fe-deff0d677b1e_del complete
Oct 17 12:02:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:02:56 user nova-compute[74261]: INFO nova.compute.manager [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 17 12:02:56 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:02:56 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:57 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Took 0.81 seconds to deallocate network for instance.
Oct 17 12:02:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-4df030a1-a4f6-4cef-9d2d-d17d61dd54ff req-9b111944-3050-485a-993d-dd78773732e1 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-deleted-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:57 user nova-compute[74261]: INFO nova.compute.manager [req-4df030a1-a4f6-4cef-9d2d-d17d61dd54ff req-9b111944-3050-485a-993d-dd78773732e1 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Neutron deleted interface 51ae7fa5-0161-409c-b261-552e0fc76030; detaching it from the instance and deleting it from the info cache
Oct 17 12:02:57 user nova-compute[74261]: DEBUG nova.network.neutron [req-4df030a1-a4f6-4cef-9d2d-d17d61dd54ff req-9b111944-3050-485a-993d-dd78773732e1 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-4df030a1-a4f6-4cef-9d2d-d17d61dd54ff req-9b111944-3050-485a-993d-dd78773732e1 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Detach interface failed, port_id=51ae7fa5-0161-409c-b261-552e0fc76030, reason: Instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-9210df39-142e-4592-9b32-3489f67b8528 req-0e6ff8f3-07eb-49f8-a836-2b5aa1454f71 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9210df39-142e-4592-9b32-3489f67b8528 req-0e6ff8f3-07eb-49f8-a836-2b5aa1454f71 service nova] Acquiring lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9210df39-142e-4592-9b32-3489f67b8528 req-0e6ff8f3-07eb-49f8-a836-2b5aa1454f71 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9210df39-142e-4592-9b32-3489f67b8528 req-0e6ff8f3-07eb-49f8-a836-2b5aa1454f71 service nova] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-9210df39-142e-4592-9b32-3489f67b8528 req-0e6ff8f3-07eb-49f8-a836-2b5aa1454f71 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] No waiting events found dispatching network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:02:57 user nova-compute[74261]: WARNING nova.compute.manager [req-9210df39-142e-4592-9b32-3489f67b8528 req-0e6ff8f3-07eb-49f8-a836-2b5aa1454f71 service nova] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Received unexpected event network-vif-plugged-51ae7fa5-0161-409c-b261-552e0fc76030 for instance with vm_state active and task_state deleting.
Oct 17 12:02:58 user nova-compute[74261]: INFO nova.compute.manager [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Took 0.79 seconds to detach 1 volumes for instance.
Oct 17 12:02:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: 33e3905d-6e09-4b49-b1fe-deff0d677b1e] Deleting volume: a9822d0e-a521-405d-9f3f-82ea5a209ca9 {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 12:02:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:58 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:02:58 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:02:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:58 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Deleted allocations for instance 33e3905d-6e09-4b49-b1fe-deff0d677b1e
Oct 17 12:02:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5fe2613e-a91d-4777-8d48-7bad1d6b39e6 tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "33e3905d-6e09-4b49-b1fe-deff0d677b1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.357s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:02:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "82177488-87bb-4e64-9653-99f01b080ec0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:02:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:02:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:02:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:02:59 user nova-compute[74261]: INFO nova.compute.claims [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Claim successful on node user
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:03:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.policy [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d191be36a54216a9e2d6a64660e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b95f3129c4493b0a69149e5b8dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:03:00 user nova-compute[74261]: INFO nova.virt.block_device [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Booting with volume-backed-image 2b60d4df-2b06-4b78-b4ef-1c17d613f5c0 at /dev/vda
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.compute.manager [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-changed-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.compute.manager [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Refreshing instance network info cache due to event network-changed-8f4b571d-0d8b-4f45-86c0-6712b8e41b79. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] Acquiring lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] Acquired lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:03:00 user nova-compute[74261]: DEBUG nova.network.neutron [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Refreshing network info cache for port 8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Successfully created port: 2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.network.neutron [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updated VIF entry in instance network info cache for port 8f4b571d-0d8b-4f45-86c0-6712b8e41b79. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.network.neutron [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updating instance_info_cache with network_info: [{"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fa2c780e-e257-4896-9599-56dc436aa25a req-9502a97c-47fc-493d-8a61-63231e57d9dd service nova] Releasing lock "refresh_cache-182b51fb-f06d-4f49-b16a-ace65fa621ed" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Successfully updated port: 2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-changed-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Refreshing instance network info cache due to event network-changed-2f64c965-25b5-415a-9405-d51308c7243f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] Acquiring lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:03:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating instance_info_cache with network_info: [{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance network_info: |[{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] Acquired lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Refreshing network info cache for port 2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updated VIF entry in instance network info cache for port 2f64c965-25b5-415a-9405-d51308c7243f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating instance_info_cache with network_info: [{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f1153570-703f-448d-957f-2f528ba611e8 req-2a0cabc6-da0e-42f0-bf97-9ececb88182a service nova] Releasing lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:03:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG nova.objects.instance [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lazy-loading 'flavor' on Instance uuid 182b51fb-f06d-4f49-b16a-ace65fa621ed {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:07 user nova-compute[74261]: INFO nova.compute.manager [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Attaching volume b433ccfa-744b-48b2-8551-e57b2565d92d to /dev/vdb
Oct 17 12:03:07 user nova-compute[74261]: DEBUG os_brick.utils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b837dd3d-4da8-43a0-86ca-96b54e4b9abc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008b49a-a320-42cb-b2b0-a0fda7387944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1161bca2-9592-4f14-8266-8e126159a674]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bf5178-12de-4fcf-936e-43a621ff5f09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:03:07 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:03:07 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d8a7a6-94ac-4c24-8cc5-93c7d8bd83d7]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG os_brick.utils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:03:07 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updating existing volume attachment record: d38ebc67-fc10-4e86-a367-a96a979f4253 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:03:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:03:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:03:14 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:03:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=25.049373626708984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:03:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f0f6a950-d984-4ece-9a20-134bf800db37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 182b51fb-f06d-4f49-b16a-ace65fa621ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 36bc1d33-3e18-4c25-94b2-f8d25f977a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 82177488-87bb-4e64-9653-99f01b080ec0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:03:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG os_brick.utils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[356cab75-0c2b-49e5-b3e5-54c2ab1d81e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce22e503-9440-4edc-b37e-8cc55d4c52cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1cd7d-e167-46bc-96b7-1d44874ab907]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0156fef-64d3-4fe5-8e6e-85282108608e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:03:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:03:17 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:03:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d249a-7c4d-458e-acbd-57076b834765]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG os_brick.utils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating existing volume attachment record: c1a5dd3b-daa7-48db-875f-76866b56712b {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:03:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:03:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:03:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWnFaOBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:03:25 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:03:25 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:03:25 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[402367a2-4571-4b6e-9c29-fb5756c62246]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:03:25 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02f87d-2a26-4031-8bb8-d34c739d5a64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d] added
Oct 17 12:03:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd6f1dc-75ee-4e7d-ad49-a0b03429efe1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[46100a81-4d35-475d-a4fe-dcb273b52f77]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWnFaOBG {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWnFaOBG" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b482c-1afe-421a-b598-045cca59424b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kWnFaOBG'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ce0eaf-1b22-4348-927a-296d5c1be204]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c187fb5-726c-4b9c-9813-d655e1d51a54]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[95241685-e3b5-4913-b81b-87fb7f8b0e95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260]
Oct 17 12:03:26 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260] successful.
Oct 17 12:03:26 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf8ecaf-4eb5-480e-ba31-7cf71ac3739d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51cc01b-5267-430e-b7d8-7044be86fcc1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:26 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:26 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:26 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe1781b-05bf-4904-bf14-58c1e9d6eb47]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:03:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWnFaOBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26166343363626362', 'path': '/dev/sdd'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166343363626362', 'path': '/dev/sdd'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG nova.objects.instance [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lazy-loading 'flavor' on Instance uuid 182b51fb-f06d-4f49-b16a-ace65fa621ed {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:03:27 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:03:27 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 12:03:27 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:03:27 user nova-compute[74261]:   <serial>b433ccfa-744b-48b2-8551-e57b2565d92d</serial>
Oct 17 12:03:27 user nova-compute[74261]: </disk>
Oct 17 12:03:27 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] No VIF found with MAC fa:16:3e:f7:a0:ad, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:03:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-360501a8-8e7a-4a36-8cd4-f078279b258f tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.222s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:29 user nova-compute[74261]: INFO nova.compute.manager [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Detaching volume b433ccfa-744b-48b2-8551-e57b2565d92d
Oct 17 12:03:29 user nova-compute[74261]: INFO nova.virt.block_device [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Attempting to driver detach volume b433ccfa-744b-48b2-8551-e57b2565d92d from mountpoint /dev/vdb
Oct 17 12:03:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Attempting to detach device vdb from instance 182b51fb-f06d-4f49-b16a-ace65fa621ed from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:03:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:03:29 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:03:29 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 12:03:29 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:03:29 user nova-compute[74261]:   <serial>b433ccfa-744b-48b2-8551-e57b2565d92d</serial>
Oct 17 12:03:29 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:03:29 user nova-compute[74261]: </disk>
Oct 17 12:03:29 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:03:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Successfully detached device vdb from instance 182b51fb-f06d-4f49-b16a-ace65fa621ed from the persistent domain config.
Oct 17 12:03:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 182b51fb-f06d-4f49-b16a-ace65fa621ed from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:03:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:03:29 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:03:29 user nova-compute[74261]:   <source dev="/dev/sdd"/>
Oct 17 12:03:29 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:03:29 user nova-compute[74261]:   <serial>b433ccfa-744b-48b2-8551-e57b2565d92d</serial>
Oct 17 12:03:29 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:03:29 user nova-compute[74261]: </disk>
Oct 17 12:03:29 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:03:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 182b51fb-f06d-4f49-b16a-ace65fa621ed {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:03:34 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Creating image(s)
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Ensure instance console log exists: /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Start _get_guest_xml network_info=[{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'c1a5dd3b-daa7-48db-875f-76866b56712b', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82177488-87bb-4e64-9653-99f01b080ec0', 'attached_at': '', 'detached_at': '', 'volume_id': '26bc3d98-c013-449a-af6d-4dee21acf15c', 'serial': '26bc3d98-c013-449a-af6d-4dee21acf15c'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:03:34 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:03:34 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:03:34 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:03:34 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:03:34 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0795f6c-758b-4a00-a573-91729266ce49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:03:34 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d9b98d-f40d-4052-be8c-df5c9f614866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c] added
Oct 17 12:03:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505c688-7acc-4f0d-a350-a65e7df77d6f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[409cb22a-ef9e-433a-99e0-f98eab00ad97]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRVkDOiK {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRVkDOiK" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d532756-5c6e-4787-9c88-5aa23752264a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRVkDOiK'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0eea45-7cea-4e35-9e8b-0319b338775f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7fb9b-3064-4cf2-8c64-071a52816481]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a30162-ee0c-49be-b9a0-413c100f458e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260]
Oct 17 12:03:34 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260] successful.
Oct 17 12:03:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e2e545-a497-4e8e-8c57-a8b3e1412517]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e33f28-dd15-4fe8-9ae2-91965e8a761e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:03:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:34 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:03:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebf3f79-b32a-4ebc-810c-dfcfb1d438ce]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:03:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26232646665313962', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232646665313962', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1958567919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1958567919',id=37,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-ggx4g40y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:03:00Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=82177488-87bb-4e64-9653-99f01b080ec0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.objects.instance [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'pci_devices' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:03:35 user nova-compute[74261]:   <uuid>82177488-87bb-4e64-9653-99f01b080ec0</uuid>
Oct 17 12:03:35 user nova-compute[74261]:   <name>instance-00000025</name>
Oct 17 12:03:35 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:03:35 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:03:35 user nova-compute[74261]:   <metadata>
Oct 17 12:03:35 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:03:35 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:03:35 user nova-compute[74261]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1958567919</nova:name>
Oct 17 12:03:35 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:03:34</nova:creationTime>
Oct 17 12:03:35 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:03:35 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:03:35 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:03:35 user nova-compute[74261]:       <nova:owner>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:user uuid="19d191be36a54216a9e2d6a64660e582">tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member</nova:user>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:project uuid="022b95f3129c4493b0a69149e5b8dd4e">tempest-ServerBootFromVolumeStableRescueTest-1400453141</nova:project>
Oct 17 12:03:35 user nova-compute[74261]:       </nova:owner>
Oct 17 12:03:35 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:03:35 user nova-compute[74261]:       <nova:ports>
Oct 17 12:03:35 user nova-compute[74261]:         <nova:port uuid="2f64c965-25b5-415a-9405-d51308c7243f">
Oct 17 12:03:35 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 12:03:35 user nova-compute[74261]:         </nova:port>
Oct 17 12:03:35 user nova-compute[74261]:       </nova:ports>
Oct 17 12:03:35 user nova-compute[74261]:     </nova:instance>
Oct 17 12:03:35 user nova-compute[74261]:   </metadata>
Oct 17 12:03:35 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:03:35 user nova-compute[74261]:     <system>
Oct 17 12:03:35 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:03:35 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:03:35 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:03:35 user nova-compute[74261]:       <entry name="serial">82177488-87bb-4e64-9653-99f01b080ec0</entry>
Oct 17 12:03:35 user nova-compute[74261]:       <entry name="uuid">82177488-87bb-4e64-9653-99f01b080ec0</entry>
Oct 17 12:03:35 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:03:35 user nova-compute[74261]:     </system>
Oct 17 12:03:35 user nova-compute[74261]:   </sysinfo>
Oct 17 12:03:35 user nova-compute[74261]:   <os>
Oct 17 12:03:35 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:03:35 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:03:35 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:03:35 user nova-compute[74261]:   </os>
Oct 17 12:03:35 user nova-compute[74261]:   <features>
Oct 17 12:03:35 user nova-compute[74261]:     <acpi/>
Oct 17 12:03:35 user nova-compute[74261]:     <apic/>
Oct 17 12:03:35 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:03:35 user nova-compute[74261]:   </features>
Oct 17 12:03:35 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:03:35 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:03:35 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:03:35 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:03:35 user nova-compute[74261]:   </clock>
Oct 17 12:03:35 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:03:35 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:03:35 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:03:35 user nova-compute[74261]:   </cpu>
Oct 17 12:03:35 user nova-compute[74261]:   <devices>
Oct 17 12:03:35 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:03:35 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:03:35 user nova-compute[74261]:       <source dev="/dev/sde"/>
Oct 17 12:03:35 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:03:35 user nova-compute[74261]:       <serial>26bc3d98-c013-449a-af6d-4dee21acf15c</serial>
Oct 17 12:03:35 user nova-compute[74261]:     </disk>
Oct 17 12:03:35 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:03:35 user nova-compute[74261]:       <mac address="fa:16:3e:2d:0c:f7"/>
Oct 17 12:03:35 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:03:35 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:03:35 user nova-compute[74261]:       <target dev="tap2f64c965-25"/>
Oct 17 12:03:35 user nova-compute[74261]:     </interface>
Oct 17 12:03:35 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:03:35 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/console.log" append="off"/>
Oct 17 12:03:35 user nova-compute[74261]:     </serial>
Oct 17 12:03:35 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:03:35 user nova-compute[74261]:     <video>
Oct 17 12:03:35 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:03:35 user nova-compute[74261]:     </video>
Oct 17 12:03:35 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:03:35 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:03:35 user nova-compute[74261]:     </rng>
Oct 17 12:03:35 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:03:35 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:03:35 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:03:35 user nova-compute[74261]:     </memballoon>
Oct 17 12:03:35 user nova-compute[74261]:   </devices>
Oct 17 12:03:35 user nova-compute[74261]: </domain>
Oct 17 12:03:35 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1958567919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1958567919',id=37,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-ggx4g40y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:03:00Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=82177488-87bb-4e64-9653-99f01b080ec0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG os_vif [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7854f31f-16e8-5c62-9113-68e6ea284fd0', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f64c965-25, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f64c965-25, col_values=(('qos', UUID('d2047fc5-a00a-4106-a25b-36e760afae67')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f64c965-25, col_values=(('external_ids', {'iface-id': '2f64c965-25b5-415a-9405-d51308c7243f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:0c:f7', 'vm-uuid': '82177488-87bb-4e64-9653-99f01b080ec0'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:03:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:36 user nova-compute[74261]: INFO os_vif [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25')
Oct 17 12:03:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:03:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No VIF found with MAC fa:16:3e:2d:0c:f7, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-8b9ddfd6-de54-4573-b633-2b7454281794 req-35370534-8bd4-46d2-b36a-309e8a8e72a1 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8b9ddfd6-de54-4573-b633-2b7454281794 req-35370534-8bd4-46d2-b36a-309e8a8e72a1 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8b9ddfd6-de54-4573-b633-2b7454281794 req-35370534-8bd4-46d2-b36a-309e8a8e72a1 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8b9ddfd6-de54-4573-b633-2b7454281794 req-35370534-8bd4-46d2-b36a-309e8a8e72a1 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-8b9ddfd6-de54-4573-b633-2b7454281794 req-35370534-8bd4-46d2-b36a-309e8a8e72a1 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:03:37 user nova-compute[74261]: WARNING nova.compute.manager [req-8b9ddfd6-de54-4573-b633-2b7454281794 req-35370534-8bd4-46d2-b36a-309e8a8e72a1 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state building and task_state spawning.
Oct 17 12:03:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:03:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance spawned successfully.
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-b833f331-b596-461c-ab32-223b6677ab5c req-fa30e28c-da3d-45b5-859c-56bdfa3d712a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b833f331-b596-461c-ab32-223b6677ab5c req-fa30e28c-da3d-45b5-859c-56bdfa3d712a service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b833f331-b596-461c-ab32-223b6677ab5c req-fa30e28c-da3d-45b5-859c-56bdfa3d712a service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b833f331-b596-461c-ab32-223b6677ab5c req-fa30e28c-da3d-45b5-859c-56bdfa3d712a service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-b833f331-b596-461c-ab32-223b6677ab5c req-fa30e28c-da3d-45b5-859c-56bdfa3d712a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:03:39 user nova-compute[74261]: WARNING nova.compute.manager [req-b833f331-b596-461c-ab32-223b6677ab5c req-fa30e28c-da3d-45b5-859c-56bdfa3d712a service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state building and task_state spawning.
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:03:39 user nova-compute[74261]: INFO nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 17 12:03:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:03:39 user nova-compute[74261]: INFO nova.compute.manager [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Took 39.98 seconds to build instance.
Oct 17 12:03:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cd29c579-6283-493c-9c55-d84061568360 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "82177488-87bb-4e64-9653-99f01b080ec0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.176s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing instance network info cache due to event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:03:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:03:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:03:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updated VIF entry in instance network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-03715c9a-4690-4c72-9138-af2b190a5805 req-726f0858-f1a2-4f14-ba04-5e896e182bbb service nova] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:03:44 user nova-compute[74261]: INFO nova.compute.manager [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Detaching volume 7d5c052b-d9a7-41dd-acc1-f199deb05e16
Oct 17 12:03:44 user nova-compute[74261]: INFO nova.virt.block_device [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Attempting to driver detach volume 7d5c052b-d9a7-41dd-acc1-f199deb05e16 from mountpoint /dev/vdb
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Attempting to detach device vdb from instance f9098343-8120-48b2-848b-2807bb60eb73 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:03:44 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:03:44 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:03:44 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:03:44 user nova-compute[74261]:   <serial>7d5c052b-d9a7-41dd-acc1-f199deb05e16</serial>
Oct 17 12:03:44 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:03:44 user nova-compute[74261]: </disk>
Oct 17 12:03:44 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:03:44 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully detached device vdb from instance f9098343-8120-48b2-848b-2807bb60eb73 from the persistent domain config.
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9098343-8120-48b2-848b-2807bb60eb73 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:03:44 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:03:44 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:03:44 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:03:44 user nova-compute[74261]:   <serial>7d5c052b-d9a7-41dd-acc1-f199deb05e16</serial>
Oct 17 12:03:44 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:03:44 user nova-compute[74261]: </disk>
Oct 17 12:03:44 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:03:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:03:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing instance network info cache due to event network-changed-fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:03:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] Acquiring lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:03:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] Acquired lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:03:45 user nova-compute[74261]: DEBUG nova.network.neutron [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Refreshing network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:03:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:46 user nova-compute[74261]: DEBUG nova.network.neutron [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updated VIF entry in instance network info cache for port fed586ab-a4b9-4c76-8dae-1859edf00501. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:03:46 user nova-compute[74261]: DEBUG nova.network.neutron [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [{"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eab4f784-e4e1-411d-a2a9-d53bdb85e269 req-c2aebdd1-6833-4a77-a150-9bf3d126957c service nova] Releasing lock "refresh_cache-f9098343-8120-48b2-848b-2807bb60eb73" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:03:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 182b51fb-f06d-4f49-b16a-ace65fa621ed is timed out.
Oct 17 12:03:50 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Successfully detached device vdb from instance 182b51fb-f06d-4f49-b16a-ace65fa621ed from the live domain config.
Oct 17 12:03:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWnFaOBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:03:50 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3506704-d359-4932-a926-59878e38a619]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:03:50 user nova-compute[74261]: No targets found.
Oct 17 12:03:50 user nova-compute[74261]: iSNS:
Oct 17 12:03:50 user nova-compute[74261]: No targets found.
Oct 17 12:03:50 user nova-compute[74261]: STATIC:
Oct 17 12:03:50 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16
Oct 17 12:03:50 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:03:50 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:03:50 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d
Oct 17 12:03:50 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:03:50 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:03:50 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:03:50 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:03:50 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:03:50 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c
Oct 17 12:03:50 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:03:50 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:03:50 user nova-compute[74261]: FIRMWARE:
Oct 17 12:03:50 user nova-compute[74261]: No targets found.
Oct 17 12:03:50 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:03:50 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:03:50 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[697329b6-f61c-4196-889b-510fdfb20f50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4888bf-9170-4c30-a1a9-d8a53009ba81]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:50 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:50 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:50 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:03:50 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:03:50 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:03:50 user nova-compute[74261]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d (non-flash)
Oct 17 12:03:50 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:03:50 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2ba0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d'): ({'sdd'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Removing single pathed devices sdd {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a56b02-55c9-43fd-b535-815707acec60]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca565b-dc97-4361-81e9-0e135380b526]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Flushing IO for device /dev/sdd {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f05184d-7295-4ff2-8ff8-b0391303786e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e7d892-aa57-49cc-a59f-2eaf3c1a213c]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f10d51-db47-4219-81d4-6aab872831c8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374307f-7d1e-44c9-ac0b-d81c23b9eec1]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260]
Oct 17 12:03:50 user nova-compute[74261]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d, portal: 172.16.0.220,3260] successful.
Oct 17 12:03:50 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b433ccfa-744b-48b2-8551-e57b2565d92d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e2bf3-9843-487a-8097-c2a4229b3b06]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] <== disconnect_volume: return (352ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:03:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:03:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:51 user nova-compute[74261]: DEBUG nova.objects.instance [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lazy-loading 'flavor' on Instance uuid 182b51fb-f06d-4f49-b16a-ace65fa621ed {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:03:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bce69727-b21f-44f6-8fc2-05c94028f775 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:55 user nova-compute[74261]: INFO nova.compute.manager [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Terminating instance
Oct 17 12:03:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-0247d07d-95c2-44b0-811f-7d58d769cd69 req-a6f938c7-92ee-4390-b575-98620f312900 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-vif-unplugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0247d07d-95c2-44b0-811f-7d58d769cd69 req-a6f938c7-92ee-4390-b575-98620f312900 service nova] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0247d07d-95c2-44b0-811f-7d58d769cd69 req-a6f938c7-92ee-4390-b575-98620f312900 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0247d07d-95c2-44b0-811f-7d58d769cd69 req-a6f938c7-92ee-4390-b575-98620f312900 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-0247d07d-95c2-44b0-811f-7d58d769cd69 req-a6f938c7-92ee-4390-b575-98620f312900 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] No waiting events found dispatching network-vif-unplugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-0247d07d-95c2-44b0-811f-7d58d769cd69 req-a6f938c7-92ee-4390-b575-98620f312900 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-vif-unplugged-201cf343-4cde-41f1-b5c3-166f7583eb1d for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:03:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Instance destroyed successfully.
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lazy-loading 'resources' on Instance uuid f0f6a950-d984-4ece-9a20-134bf800db37 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2051220957',display_name='tempest-ServerActionsTestOtherA-server-2051220957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2051220957',id=2,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACjJg0cX2H2hNGGzE67V016iXCsJlwFlv5PhMgdA3hy3/NsBtpSpRdhffj59CjCbFkx3xq4+Rof3408AWPX3g7E1/fRqdnruJhEwjVXMXlu5xkR1gNrcJMYqZYokB2RmQ==',key_name='tempest-keypair-105723068',keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:44:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e92694390284b84b82715d4086494e9',ramdisk_id='',reservation_id='r-3kr402p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203196858',owner_user_name='tempest-ServerActionsTestOtherA-203196858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29e0ea554e49c6b7ea83629e0f88c6',uuid=f0f6a950-d984-4ece-9a20-134bf800db37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converting VIF {"id": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "address": "fa:16:3e:29:de:97", "network": {"id": "e45d69fe-2e0d-4203-b353-528766785900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1651452110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e92694390284b84b82715d4086494e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201cf343-4c", "ovs_interfaceid": "201cf343-4cde-41f1-b5c3-166f7583eb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG os_vif [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201cf343-4c, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c041a6e-8ddc-4024-a4ec-e3f3ee31b6cd) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:03:56 user nova-compute[74261]: INFO os_vif [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:de:97,bridge_name='br-int',has_traffic_filtering=True,id=201cf343-4cde-41f1-b5c3-166f7583eb1d,network=Network(e45d69fe-2e0d-4203-b353-528766785900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201cf343-4c')
Oct 17 12:03:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Deleting instance files /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37_del
Oct 17 12:03:56 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Deletion of /opt/stack/data/nova/instances/f0f6a950-d984-4ece-9a20-134bf800db37_del complete
Oct 17 12:03:56 user nova-compute[74261]: INFO nova.compute.manager [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 17 12:03:56 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:03:56 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:03:57 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:03:57 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Took 0.54 seconds to deallocate network for instance.
Oct 17 12:03:57 user nova-compute[74261]: DEBUG nova.compute.manager [req-29625e76-00fd-44a4-bcfc-a2de685c6b50 req-ef29f066-7b2c-48f5-9fa4-ca5ba072caa7 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-vif-deleted-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:57 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:03:57 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:03:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:57 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Deleted allocations for instance f0f6a950-d984-4ece-9a20-134bf800db37
Oct 17 12:03:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-91ee9e76-26a1-4523-85df-d4adcc583b0f tempest-ServerActionsTestOtherA-203196858 tempest-ServerActionsTestOtherA-203196858-project-member] Lock "f0f6a950-d984-4ece-9a20-134bf800db37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-e63f32e9-a443-4ef9-aeca-96c01f07e754 req-ec1c7272-c703-4c69-b58d-c1d692631be3 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received event network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:03:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e63f32e9-a443-4ef9-aeca-96c01f07e754 req-ec1c7272-c703-4c69-b58d-c1d692631be3 service nova] Acquiring lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:03:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e63f32e9-a443-4ef9-aeca-96c01f07e754 req-ec1c7272-c703-4c69-b58d-c1d692631be3 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:03:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-e63f32e9-a443-4ef9-aeca-96c01f07e754 req-ec1c7272-c703-4c69-b58d-c1d692631be3 service nova] Lock "f0f6a950-d984-4ece-9a20-134bf800db37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:03:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-e63f32e9-a443-4ef9-aeca-96c01f07e754 req-ec1c7272-c703-4c69-b58d-c1d692631be3 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] No waiting events found dispatching network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:03:58 user nova-compute[74261]: WARNING nova.compute.manager [req-e63f32e9-a443-4ef9-aeca-96c01f07e754 req-ec1c7272-c703-4c69-b58d-c1d692631be3 service nova] [instance: f0f6a950-d984-4ece-9a20-134bf800db37] Received unexpected event network-vif-plugged-201cf343-4cde-41f1-b5c3-166f7583eb1d for instance with vm_state deleted and task_state None.
Oct 17 12:04:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:04 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9098343-8120-48b2-848b-2807bb60eb73 is timed out.
Oct 17 12:04:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully detached device vdb from instance f9098343-8120-48b2-848b-2807bb60eb73 from the live domain config.
Oct 17 12:04:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvCltdBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:04:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:04:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebedc9d5-6c68-4c3a-8605-7f920ad081e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:04:04 user nova-compute[74261]: No targets found.
Oct 17 12:04:04 user nova-compute[74261]: iSNS:
Oct 17 12:04:04 user nova-compute[74261]: No targets found.
Oct 17 12:04:04 user nova-compute[74261]: STATIC:
Oct 17 12:04:04 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16
Oct 17 12:04:04 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:04:04 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:04:04 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:04:04 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:04:04 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:04:04 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c
Oct 17 12:04:04 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:04:04 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:04:04 user nova-compute[74261]: FIRMWARE:
Oct 17 12:04:04 user nova-compute[74261]: No targets found.
Oct 17 12:04:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:04:04 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:04:04 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2ce8c-dab6-4c7e-bb36-4a4486052f43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b33d7b0-82c3-459d-8f44-4305f0ab7696]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:04:05 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:04:05 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:04:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:04:05 user nova-compute[74261]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 (non-flash)
Oct 17 12:04:05 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:04:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c242d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bdfa55-eab8-48ce-b033-51e42c823ec3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd49523c-f31c-4054-b137-09b4b708c7d6]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437aa2e-f03f-4dc1-bae5-aedfd34be970]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671950c-004d-4807-9c54-2a514b439a58]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b39e0-fa12-46f0-a506-59acefefee6c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f130661-2b33-43dd-89fd-c29795523de0]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260]
Oct 17 12:04:05 user nova-compute[74261]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16, portal: 172.16.0.220,3260] successful.
Oct 17 12:04:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5c052b-d9a7-41dd-acc1-f199deb05e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4048318-86fc-48be-ae62-bce7748a7b28]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] <== disconnect_volume: return (304ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:04:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:04:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:07 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'flavor' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f5c83162-8f0b-4caa-9903-5bf611b798d4 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.074s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:08 user nova-compute[74261]: INFO nova.compute.manager [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Unshelving
Oct 17 12:04:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'pci_requests' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:04:08 user nova-compute[74261]: INFO nova.compute.claims [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Claim successful on node user
Oct 17 12:04:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:04:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:08 user nova-compute[74261]: INFO nova.network.neutron [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing instance network info cache due to event network-changed-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] Acquiring lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:04:09 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Creating image(s)
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] Acquired lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Refreshing network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG nova.objects.base [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<7c9b0f63-db8b-4314-b916-56e9dc65b675> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "72a591a9c59aeb070caeece67ca6e9b74116ebc5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "72a591a9c59aeb070caeece67ca6e9b74116ebc5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG nova.virt.images [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] b890e6ae-9223-4351-a84e-71e3b986d0b7 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.part /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.part /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.converted" returned: 0 in 0.319s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG nova.network.neutron [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updated VIF entry in instance network info cache for port d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG nova.network.neutron [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-83a6a7f4-75fb-460d-b27a-084cecd1384b req-7369dff6-bb17-47c0-a94d-1d163e4ebe00 service nova] Releasing lock "refresh_cache-7c9b0f63-db8b-4314-b916-56e9dc65b675" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "72a591a9c59aeb070caeece67ca6e9b74116ebc5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.131s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "72a591a9c59aeb070caeece67ca6e9b74116ebc5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "72a591a9c59aeb070caeece67ca6e9b74116ebc5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5,backing_fmt=raw /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5,backing_fmt=raw /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk 1073741824" returned: 0 in 0.051s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "72a591a9c59aeb070caeece67ca6e9b74116ebc5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'migration_context' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG nova.objects.base [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<7c9b0f63-db8b-4314-b916-56e9dc65b675> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:12 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Rebasing disk image.
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.195s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c -F raw /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:04:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:04:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=7870MB free_disk=24.975177764892578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance f9098343-8120-48b2-848b-2807bb60eb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 182b51fb-f06d-4f49-b16a-ace65fa621ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 36bc1d33-3e18-4c25-94b2-f8d25f977a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 82177488-87bb-4e64-9653-99f01b080ec0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d51b7aad-e6a4-40b3-931d-8430348db4c8): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c -F raw /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk" returned: 0 in 2.698s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Start _get_guest_xml network_info=[{"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f5d0fcc316d97793f91af3576d954f46',container_format='bare',created_at=2023-10-17T12:02:15Z,direct_url=<?>,disk_format='qcow2',id=b890e6ae-9223-4351-a84e-71e3b986d0b7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-150427143-shelved',owner='117fbb67e9764c1e9e3211ba9a08b864',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T12:02:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:04:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:04:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f5d0fcc316d97793f91af3576d954f46',container_format='bare',created_at=2023-10-17T12:02:15Z,direct_url=<?>,disk_format='qcow2',id=b890e6ae-9223-4351-a84e-71e3b986d0b7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-150427143-shelved',owner='117fbb67e9764c1e9e3211ba9a08b864',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T12:02:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.objects.base [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<7c9b0f63-db8b-4314-b916-56e9dc65b675> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T12:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-150427143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-150427143',id=34,image_ref='b890e6ae-9223-4351-a84e-71e3b986d0b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-817985384',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-ua1yvbj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member',shelved_at='2023-10-17T12:02:20.038261',shelved_host='user',shelved_image_id='b890e6ae-9223-4351-a84e-71e3b986d0b7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=7c9b0f63-db8b-4314-b916-56e9dc65b675,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.objects.base [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Object Instance<7c9b0f63-db8b-4314-b916-56e9dc65b675> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:04:15 user nova-compute[74261]:   <uuid>7c9b0f63-db8b-4314-b916-56e9dc65b675</uuid>
Oct 17 12:04:15 user nova-compute[74261]:   <name>instance-00000022</name>
Oct 17 12:04:15 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:04:15 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:04:15 user nova-compute[74261]:   <metadata>
Oct 17 12:04:15 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:04:15 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:04:15 user nova-compute[74261]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-150427143</nova:name>
Oct 17 12:04:15 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:04:15</nova:creationTime>
Oct 17 12:04:15 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:04:15 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:04:15 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:04:15 user nova-compute[74261]:       <nova:owner>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:user uuid="229ff57765914e75a370db408f67c501">tempest-AttachVolumeShelveTestJSON-63868510-project-member</nova:user>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:project uuid="117fbb67e9764c1e9e3211ba9a08b864">tempest-AttachVolumeShelveTestJSON-63868510</nova:project>
Oct 17 12:04:15 user nova-compute[74261]:       </nova:owner>
Oct 17 12:04:15 user nova-compute[74261]:       <nova:root type="image" uuid="b890e6ae-9223-4351-a84e-71e3b986d0b7"/>
Oct 17 12:04:15 user nova-compute[74261]:       <nova:ports>
Oct 17 12:04:15 user nova-compute[74261]:         <nova:port uuid="d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17">
Oct 17 12:04:15 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 12:04:15 user nova-compute[74261]:         </nova:port>
Oct 17 12:04:15 user nova-compute[74261]:       </nova:ports>
Oct 17 12:04:15 user nova-compute[74261]:     </nova:instance>
Oct 17 12:04:15 user nova-compute[74261]:   </metadata>
Oct 17 12:04:15 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:04:15 user nova-compute[74261]:     <system>
Oct 17 12:04:15 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:04:15 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:04:15 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:04:15 user nova-compute[74261]:       <entry name="serial">7c9b0f63-db8b-4314-b916-56e9dc65b675</entry>
Oct 17 12:04:15 user nova-compute[74261]:       <entry name="uuid">7c9b0f63-db8b-4314-b916-56e9dc65b675</entry>
Oct 17 12:04:15 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:04:15 user nova-compute[74261]:     </system>
Oct 17 12:04:15 user nova-compute[74261]:   </sysinfo>
Oct 17 12:04:15 user nova-compute[74261]:   <os>
Oct 17 12:04:15 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:04:15 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:04:15 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:04:15 user nova-compute[74261]:   </os>
Oct 17 12:04:15 user nova-compute[74261]:   <features>
Oct 17 12:04:15 user nova-compute[74261]:     <acpi/>
Oct 17 12:04:15 user nova-compute[74261]:     <apic/>
Oct 17 12:04:15 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:04:15 user nova-compute[74261]:   </features>
Oct 17 12:04:15 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:04:15 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:04:15 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:04:15 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:04:15 user nova-compute[74261]:   </clock>
Oct 17 12:04:15 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:04:15 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:04:15 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:04:15 user nova-compute[74261]:   </cpu>
Oct 17 12:04:15 user nova-compute[74261]:   <devices>
Oct 17 12:04:15 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:04:15 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:04:15 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk"/>
Oct 17 12:04:15 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:04:15 user nova-compute[74261]:     </disk>
Oct 17 12:04:15 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:04:15 user nova-compute[74261]:       <mac address="fa:16:3e:fb:4d:b3"/>
Oct 17 12:04:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:04:15 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:04:15 user nova-compute[74261]:       <target dev="tapd4b27ad8-3d"/>
Oct 17 12:04:15 user nova-compute[74261]:     </interface>
Oct 17 12:04:15 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:04:15 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/console.log" append="off"/>
Oct 17 12:04:15 user nova-compute[74261]:     </serial>
Oct 17 12:04:15 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:04:15 user nova-compute[74261]:     <video>
Oct 17 12:04:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:04:15 user nova-compute[74261]:     </video>
Oct 17 12:04:15 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:04:15 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:04:15 user nova-compute[74261]:     </rng>
Oct 17 12:04:15 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:04:15 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:04:15 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:04:15 user nova-compute[74261]:     </memballoon>
Oct 17 12:04:15 user nova-compute[74261]:   </devices>
Oct 17 12:04:15 user nova-compute[74261]: </domain>
Oct 17 12:04:15 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T12:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-150427143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-150427143',id=34,image_ref='b890e6ae-9223-4351-a84e-71e3b986d0b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-817985384',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-ua1yvbj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member',shelved_at='2023-10-17T12:02:20.038261',shelved_host='user',shelved_image_id='b890e6ae-9223-4351-a84e-71e3b986d0b7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=7c9b0f63-db8b-4314-b916-56e9dc65b675,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG os_vif [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc9afa0b-bed5-55f4-9c18-b0b0b86e65bb', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4b27ad8-3d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4b27ad8-3d, col_values=(('qos', UUID('59535ed8-468e-452e-bbc4-cb77716a59d9')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4b27ad8-3d, col_values=(('external_ids', {'iface-id': 'd4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:4d:b3', 'vm-uuid': '7c9b0f63-db8b-4314-b916-56e9dc65b675'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:15 user nova-compute[74261]: INFO os_vif [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d')
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] No VIF found with MAC fa:16:3e:fb:4d:b3, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:04:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-1f5037f8-92f0-41bb-8633-a699f9e26efe req-8e05c91f-d304-4409-a782-f68bf47439e0 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1f5037f8-92f0-41bb-8633-a699f9e26efe req-8e05c91f-d304-4409-a782-f68bf47439e0 service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1f5037f8-92f0-41bb-8633-a699f9e26efe req-8e05c91f-d304-4409-a782-f68bf47439e0 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1f5037f8-92f0-41bb-8633-a699f9e26efe req-8e05c91f-d304-4409-a782-f68bf47439e0 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-1f5037f8-92f0-41bb-8633-a699f9e26efe req-8e05c91f-d304-4409-a782-f68bf47439e0 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:17 user nova-compute[74261]: WARNING nova.compute.manager [req-1f5037f8-92f0-41bb-8633-a699f9e26efe req-8e05c91f-d304-4409-a782-f68bf47439e0 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 12:04:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:04:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:04:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:04:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance spawned successfully.
Oct 17 12:04:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-d534e892-7f4f-480a-9fb7-0394f767951a req-62ffbb01-98cb-41fa-812a-0c7ca7f7d7df service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d534e892-7f4f-480a-9fb7-0394f767951a req-62ffbb01-98cb-41fa-812a-0c7ca7f7d7df service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d534e892-7f4f-480a-9fb7-0394f767951a req-62ffbb01-98cb-41fa-812a-0c7ca7f7d7df service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d534e892-7f4f-480a-9fb7-0394f767951a req-62ffbb01-98cb-41fa-812a-0c7ca7f7d7df service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-d534e892-7f4f-480a-9fb7-0394f767951a req-62ffbb01-98cb-41fa-812a-0c7ca7f7d7df service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:19 user nova-compute[74261]: WARNING nova.compute.manager [req-d534e892-7f4f-480a-9fb7-0394f767951a req-62ffbb01-98cb-41fa-812a-0c7ca7f7d7df service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 12:04:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:04:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ac8ef6c5-c91f-4626-8dbf-a864f492aae4 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.388s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:04:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:29 user nova-compute[74261]: INFO nova.compute.manager [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Terminating instance
Oct 17 12:04:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-a7085633-4b1a-49bb-bf28-b0036fbf7def req-12810b45-7c09-4d2d-a09c-c7ec9783338f service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-vif-unplugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a7085633-4b1a-49bb-bf28-b0036fbf7def req-12810b45-7c09-4d2d-a09c-c7ec9783338f service nova] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a7085633-4b1a-49bb-bf28-b0036fbf7def req-12810b45-7c09-4d2d-a09c-c7ec9783338f service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a7085633-4b1a-49bb-bf28-b0036fbf7def req-12810b45-7c09-4d2d-a09c-c7ec9783338f service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-a7085633-4b1a-49bb-bf28-b0036fbf7def req-12810b45-7c09-4d2d-a09c-c7ec9783338f service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] No waiting events found dispatching network-vif-unplugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-a7085633-4b1a-49bb-bf28-b0036fbf7def req-12810b45-7c09-4d2d-a09c-c7ec9783338f service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-vif-unplugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Instance destroyed successfully.
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lazy-loading 'resources' on Instance uuid 182b51fb-f06d-4f49-b16a-ace65fa621ed {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1049807364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1049807',id=35,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfuKSLEx6ugB+5h0oN3g6F6jB4B4i0uWL+peH+YQUYdoMzh2hT7v9rUDUpTdo+TpxjJg4dUzgcYNeHz0KNgP1N/xlpP2FbF97tQsJs7L39OMRi20kKEASiobes6uNx/yQ==',key_name='tempest-keypair-797013615',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6920a3da331440ffbbd52d3c82f12ca7',ramdisk_id='',reservation_id='r-6nf4on4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-958416770',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca990d4fdc5848e48bf42478cb180974',uuid=182b51fb-f06d-4f49-b16a-ace65fa621ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Converting VIF {"id": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "address": "fa:16:3e:f7:a0:ad", "network": {"id": "12b72e95-5193-48e3-b653-7e78f0733c79", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-574581673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6920a3da331440ffbbd52d3c82f12ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4b571d-0d", "ovs_interfaceid": "8f4b571d-0d8b-4f45-86c0-6712b8e41b79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG os_vif [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f4b571d-0d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43df789d-ec85-41ba-9418-e02e449d85b0) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:30 user nova-compute[74261]: INFO os_vif [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8f4b571d-0d8b-4f45-86c0-6712b8e41b79,network=Network(12b72e95-5193-48e3-b653-7e78f0733c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4b571d-0d')
Oct 17 12:04:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Deleting instance files /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed_del
Oct 17 12:04:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Deletion of /opt/stack/data/nova/instances/182b51fb-f06d-4f49-b16a-ace65fa621ed_del complete
Oct 17 12:04:30 user nova-compute[74261]: INFO nova.compute.manager [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 17 12:04:30 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:04:30 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:04:31 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:04:31 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Took 0.78 seconds to deallocate network for instance.
Oct 17 12:04:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:32 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Deleted allocations for instance 182b51fb-f06d-4f49-b16a-ace65fa621ed
Oct 17 12:04:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-9953e5e6-59b2-475e-b178-14578e9673e2 tempest-TestServerVolumeAttachScenarioOldVersion-958416770 tempest-TestServerVolumeAttachScenarioOldVersion-958416770-project-member] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] Acquiring lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] Lock "182b51fb-f06d-4f49-b16a-ace65fa621ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] No waiting events found dispatching network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:32 user nova-compute[74261]: WARNING nova.compute.manager [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received unexpected event network-vif-plugged-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 for instance with vm_state deleted and task_state None.
Oct 17 12:04:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-61a6cee1-c4e8-4266-9b8b-1432e5e029cd req-074145de-1a40-40f1-97cb-ed53cb558684 service nova] [instance: 182b51fb-f06d-4f49-b16a-ace65fa621ed] Received event network-vif-deleted-8f4b571d-0d8b-4f45-86c0-6712b8e41b79 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:34 user nova-compute[74261]: INFO nova.compute.manager [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Terminating instance
Oct 17 12:04:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-028fb71b-a962-41ec-b3ef-c07345637648 req-3cb2268d-82bc-46c5-ae7d-cdf27b272a92 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-028fb71b-a962-41ec-b3ef-c07345637648 req-3cb2268d-82bc-46c5-ae7d-cdf27b272a92 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-028fb71b-a962-41ec-b3ef-c07345637648 req-3cb2268d-82bc-46c5-ae7d-cdf27b272a92 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-028fb71b-a962-41ec-b3ef-c07345637648 req-3cb2268d-82bc-46c5-ae7d-cdf27b272a92 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-028fb71b-a962-41ec-b3ef-c07345637648 req-3cb2268d-82bc-46c5-ae7d-cdf27b272a92 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-028fb71b-a962-41ec-b3ef-c07345637648 req-3cb2268d-82bc-46c5-ae7d-cdf27b272a92 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-unplugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:04:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Instance destroyed successfully.
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'resources' on Instance uuid f9098343-8120-48b2-848b-2807bb60eb73 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201570900',display_name='tempest-ServerRescueNegativeTestJSON-server-201570900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201570900',id=30,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeF/gSwlEeNPSISacTsorapNh7IBA53uRWQXmuM8RSeXmFBBNdMTfcNvMadaDVtgHyJRc9aqFfmXE20arIfd3+LiOx5t16Dmt8WpcMToXi6VKDz/d0ofOb8DeFuyL4LsA==',key_name='tempest-keypair-1480772815',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-nrri5545',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171d1037b5b74e09812373e40ef7c193',uuid=f9098343-8120-48b2-848b-2807bb60eb73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "fed586ab-a4b9-4c76-8dae-1859edf00501", "address": "fa:16:3e:1b:70:17", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed586ab-a4", "ovs_interfaceid": "fed586ab-a4b9-4c76-8dae-1859edf00501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG os_vif [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfed586ab-a4, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88c678e4-b554-47b8-b4ed-03cfd430efce) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:35 user nova-compute[74261]: INFO os_vif [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:70:17,bridge_name='br-int',has_traffic_filtering=True,id=fed586ab-a4b9-4c76-8dae-1859edf00501,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed586ab-a4')
Oct 17 12:04:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Deleting instance files /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73_del
Oct 17 12:04:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Deletion of /opt/stack/data/nova/instances/f9098343-8120-48b2-848b-2807bb60eb73_del complete
Oct 17 12:04:35 user nova-compute[74261]: INFO nova.compute.manager [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 17 12:04:35 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:04:35 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:04:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:36 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:04:36 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Took 1.14 seconds to deallocate network for instance.
Oct 17 12:04:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-2bd7a852-1c6c-4c3c-82be-d89b98c3834a req-7c1b67a1-8c06-4daa-b363-e2c0452fd6e9 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-deleted-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:37 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Deleted allocations for instance f9098343-8120-48b2-848b-2807bb60eb73
Oct 17 12:04:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-0a2e70ea-7557-4b43-82d4-b4fb4c336eed req-d550748c-42de-4e42-9023-58b2f07ca966 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0a2e70ea-7557-4b43-82d4-b4fb4c336eed req-d550748c-42de-4e42-9023-58b2f07ca966 service nova] Acquiring lock "f9098343-8120-48b2-848b-2807bb60eb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0a2e70ea-7557-4b43-82d4-b4fb4c336eed req-d550748c-42de-4e42-9023-58b2f07ca966 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0a2e70ea-7557-4b43-82d4-b4fb4c336eed req-d550748c-42de-4e42-9023-58b2f07ca966 service nova] Lock "f9098343-8120-48b2-848b-2807bb60eb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-0a2e70ea-7557-4b43-82d4-b4fb4c336eed req-d550748c-42de-4e42-9023-58b2f07ca966 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] No waiting events found dispatching network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:37 user nova-compute[74261]: WARNING nova.compute.manager [req-0a2e70ea-7557-4b43-82d4-b4fb4c336eed req-d550748c-42de-4e42-9023-58b2f07ca966 service nova] [instance: f9098343-8120-48b2-848b-2807bb60eb73] Received unexpected event network-vif-plugged-fed586ab-a4b9-4c76-8dae-1859edf00501 for instance with vm_state deleted and task_state None.
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8337abce-3c4d-4f9a-af65-950d3df22b26 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "f9098343-8120-48b2-848b-2807bb60eb73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:37 user nova-compute[74261]: INFO nova.compute.manager [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Terminating instance
Oct 17 12:04:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Instance destroyed successfully.
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lazy-loading 'resources' on Instance uuid 36bc1d33-3e18-4c25-94b2-f8d25f977a28 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-546513809',display_name='tempest-VolumesActionsTest-instance-546513809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-546513809',id=36,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:02:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7caa52739dfc46c3bfa4228ef33818ba',ramdisk_id='',reservation_id='r-ftzk0o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1154658100',owner_user_name='tempest-VolumesActionsTest-1154658100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:02:39Z,user_data=None,user_id='cbe9e65516294671becfcf323392c5dc',uuid=36bc1d33-3e18-4c25-94b2-f8d25f977a28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Converting VIF {"id": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "address": "fa:16:3e:06:41:1d", "network": {"id": "209c5691-7889-4ee9-91af-84cd2ad5a2ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-637927041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7caa52739dfc46c3bfa4228ef33818ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10e006f-d1", "ovs_interfaceid": "e10e006f-d1d8-4f25-8395-c7b95d479c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG os_vif [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape10e006f-d1, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b12c982-09a0-461a-bb61-f9e3761c759a) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:38 user nova-compute[74261]: INFO os_vif [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:41:1d,bridge_name='br-int',has_traffic_filtering=True,id=e10e006f-d1d8-4f25-8395-c7b95d479c8f,network=Network(209c5691-7889-4ee9-91af-84cd2ad5a2ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10e006f-d1')
Oct 17 12:04:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Deleting instance files /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28_del
Oct 17 12:04:38 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Deletion of /opt/stack/data/nova/instances/36bc1d33-3e18-4c25-94b2-f8d25f977a28_del complete
Oct 17 12:04:38 user nova-compute[74261]: INFO nova.compute.manager [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-vif-unplugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] No waiting events found dispatching network-vif-unplugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-vif-unplugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] Acquiring lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] No waiting events found dispatching network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:38 user nova-compute[74261]: WARNING nova.compute.manager [req-4ba4bf84-9d5e-49ca-a73f-6b7825d5385d req-cfad921d-e134-404e-8825-f51885002a0a service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received unexpected event network-vif-plugged-e10e006f-d1d8-4f25-8395-c7b95d479c8f for instance with vm_state active and task_state deleting.
Oct 17 12:04:39 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:04:39 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Took 0.49 seconds to deallocate network for instance.
Oct 17 12:04:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:39 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:04:39 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:04:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:39 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Deleted allocations for instance 36bc1d33-3e18-4c25-94b2-f8d25f977a28
Oct 17 12:04:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-2fcbe680-6bc0-4e2f-9cd5-afd1b890de50 tempest-VolumesActionsTest-1154658100 tempest-VolumesActionsTest-1154658100-project-member] Lock "36bc1d33-3e18-4c25-94b2-f8d25f977a28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-657c1615-3ce2-4158-a9b9-74c8a9681eba req-b57a72d4-f0b1-4bb8-8513-f1e20e54125e service nova] [instance: 36bc1d33-3e18-4c25-94b2-f8d25f977a28] Received event network-vif-deleted-e10e006f-d1d8-4f25-8395-c7b95d479c8f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:50 user nova-compute[74261]: INFO nova.compute.manager [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Rescuing
Oct 17 12:04:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:04:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:04:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating instance_info_cache with network_info: [{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-45267fc9-c3b5-45ed-ba4a-5e6a152ec580 req-90b2af16-6949-42bb-b080-88c516438a26 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-45267fc9-c3b5-45ed-ba4a-5e6a152ec580 req-90b2af16-6949-42bb-b080-88c516438a26 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-45267fc9-c3b5-45ed-ba4a-5e6a152ec580 req-90b2af16-6949-42bb-b080-88c516438a26 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-45267fc9-c3b5-45ed-ba4a-5e6a152ec580 req-90b2af16-6949-42bb-b080-88c516438a26 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG nova.compute.manager [req-45267fc9-c3b5-45ed-ba4a-5e6a152ec580 req-90b2af16-6949-42bb-b080-88c516438a26 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:51 user nova-compute[74261]: WARNING nova.compute.manager [req-45267fc9-c3b5-45ed-ba4a-5e6a152ec580 req-90b2af16-6949-42bb-b080-88c516438a26 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance destroyed successfully.
Oct 17 12:04:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Attempting a stable device rescue
Oct 17 12:04:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74261) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance directory exists: not creating {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 12:04:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Creating image(s)
Oct 17 12:04:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "/opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "/opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'trusted_certs' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "f0191766899d5c50582a27b4e510bb28108d791f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "f0191766899d5c50582a27b4e510bb28108d791f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.virt.images [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] 1bd703f5-8b7f-4bad-9d30-3e5307f57fde was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.part /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.part /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.converted" returned: 0 in 0.418s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:53 user nova-compute[74261]: WARNING nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:53 user nova-compute[74261]: WARNING nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:53 user nova-compute[74261]: WARNING nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:53 user nova-compute[74261]: WARNING nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:53 user nova-compute[74261]: WARNING nova.compute.manager [req-274c36c8-16e3-4e55-9f57-e4c1131ebd29 req-25c5ea3b-f08b-4d2e-8e65-8bcc44ac6272 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "f0191766899d5c50582a27b4e510bb28108d791f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.863s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "f0191766899d5c50582a27b4e510bb28108d791f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "f0191766899d5c50582a27b4e510bb28108d791f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f,backing_fmt=raw /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f,backing_fmt=raw /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue" returned: 0 in 0.053s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "f0191766899d5c50582a27b4e510bb28108d791f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'migration_context' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<82177488-87bb-4e64-9653-99f01b080ec0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Start _get_guest_xml network_info=[{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "vif_mac": "fa:16:3e:2d:0c:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1bd703f5-8b7f-4bad-9d30-3e5307f57fde', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'c1a5dd3b-daa7-48db-875f-76866b56712b', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '82177488-87bb-4e64-9653-99f01b080ec0', 'attached_at': '', 'detached_at': '', 'volume_id': '26bc3d98-c013-449a-af6d-4dee21acf15c', 'serial': '26bc3d98-c013-449a-af6d-4dee21acf15c'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'resources' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<82177488-87bb-4e64-9653-99f01b080ec0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'numa_topology' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<82177488-87bb-4e64-9653-99f01b080ec0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:04:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<82177488-87bb-4e64-9653-99f01b080ec0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:04:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:04:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:04:54 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7460ca-4c0c-4503-8068-c50832ffc471]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TRVkDOiK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 17 12:04:54 user nova-compute[74261]: node.name = iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c
Oct 17 12:04:54 user nova-compute[74261]: node.tpgt = -1
Oct 17 12:04:54 user nova-compute[74261]: node.startup = automatic
Oct 17 12:04:54 user nova-compute[74261]: node.leading_login = No
Oct 17 12:04:54 user nova-compute[74261]: iface.iscsi_ifacename = default
Oct 17 12:04:54 user nova-compute[74261]: iface.net_ifacename = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.ipaddress = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.prefix_len = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.hwaddress = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.transport_name = tcp
Oct 17 12:04:54 user nova-compute[74261]: iface.initiatorname = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.vlan_id = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.vlan_priority = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.vlan_state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.iface_num = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.mtu = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.port = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.bootproto = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.subnet_mask = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.gateway = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_alt_client_id_state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_alt_client_id = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_dns = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_learn_iqn = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_req_vendor_id_state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_vendor_id_state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_vendor_id = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.dhcp_slp_da = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.fragmentation = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.gratuitous_arp = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.incoming_forwarding = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.tos_state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.tos = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.ttl = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.delayed_ack = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.tcp_nagle = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.tcp_wsf_state = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.tcp_wsf = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.tcp_timer_scale = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.tcp_timestamp = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.redirect = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.def_task_mgmt_timeout = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.header_digest = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.data_digest = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.immediate_data = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.initial_r2t = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.data_seq_inorder = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.data_pdu_inorder = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.erl = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.max_receive_data_len = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.first_burst_len = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.max_outstanding_r2t = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.max_burst_len = 0
Oct 17 12:04:54 user nova-compute[74261]: iface.chap_auth = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.bidi_chap = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.strict_login_compliance = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.discovery_auth = <empty>
Oct 17 12:04:54 user nova-compute[74261]: iface.discovery_logout = <empty>
Oct 17 12:04:54 user nova-compute[74261]: node.discovery_address = <empty>
Oct 17 12:04:54 user nova-compute[74261]: node.discovery_port = 0
Oct 17 12:04:54 user nova-compute[74261]: node.discovery_type = static
Oct 17 12:04:54 user nova-compute[74261]: node.session.initial_cmdsn = 0
Oct 17 12:04:54 user nova-compute[74261]: node.session.initial_login_retry_max = 8
Oct 17 12:04:54 user nova-compute[74261]: node.session.xmit_thread_priority = -20
Oct 17 12:04:54 user nova-compute[74261]: node.session.cmds_max = 128
Oct 17 12:04:54 user nova-compute[74261]: node.session.queue_depth = 32
Oct 17 12:04:54 user nova-compute[74261]: node.session.nr_sessions = 1
Oct 17 12:04:54 user nova-compute[74261]: node.session.auth.authmethod = CHAP
Oct 17 12:04:54 user nova-compute[74261]: node.session.auth.username = TRVkDOiK
Oct 17 12:04:54 user nova-compute[74261]: node.session.auth.password = ***
Oct 17 12:04:54 user nova-compute[74261]: node.session.auth.username_in = <empty>
Oct 17 12:04:54 user nova-compute[74261]: node.session.auth.password_in = <empty>
Oct 17 12:04:54 user nova-compute[74261]: node.session.auth.chap_algs = MD5
Oct 17 12:04:54 user nova-compute[74261]: node.session.timeo.replacement_timeout = 120
Oct 17 12:04:54 user nova-compute[74261]: node.session.err_timeo.abort_timeout = 15
Oct 17 12:04:54 user nova-compute[74261]: node.session.err_timeo.lu_reset_timeout = 30
Oct 17 12:04:54 user nova-compute[74261]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 17 12:04:54 user nova-compute[74261]: node.session.err_timeo.host_reset_timeout = 60
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.FastAbort = Yes
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.InitialR2T = No
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.ImmediateData = Yes
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.FirstBurstLength = 262144
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.MaxBurstLength = 16776192
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.DefaultTime2Retain = 0
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.DefaultTime2Wait = 2
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.MaxConnections = 1
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 17 12:04:54 user nova-compute[74261]: node.session.iscsi.ERL = 0
Oct 17 12:04:54 user nova-compute[74261]: node.session.scan = manual
Oct 17 12:04:54 user nova-compute[74261]: node.session.reopen_max = 0
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].address = 172.16.0.220
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].port = 3260
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].startup = manual
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].tcp.window_size = 524288
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].tcp.type_of_service = 0
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].timeo.logout_timeout = 15
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].timeo.login_timeout = 15
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].timeo.auth_timeout = 45
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].timeo.noop_out_interval = 5
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].timeo.noop_out_timeout = 5
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].iscsi.HeaderDigest = None
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].iscsi.DataDigest = None
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].iscsi.IFMarker = No
Oct 17 12:04:54 user nova-compute[74261]: node.conn[0].iscsi.OFMarker = No
Oct 17 12:04:54 user nova-compute[74261]: # END RECORD
Oct 17 12:04:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c63b50-78ce-46b5-a673-1b04446213e0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a96eb3-2893-4ca6-b699-65d0d7d45467]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRVkDOiK {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRVkDOiK" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7ca9ac-77ef-46b7-ac75-2f09760eace5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRVkDOiK'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9dc649-74a4-40c1-bae3-b2c5b6d211ea]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b2a11e-8ec5-4bde-a22f-279e0ff74648]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:04:54 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:04:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:04:54 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:04:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] HCTL ('36', '0', '0', 0) found on session 36 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6be234-a199-4c73-99c2-9439bdd0bbf2]: (4, ('0 0 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Searching for a device in session 36 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26232646665313962', 'path': '/dev/sde'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232646665313962', 'path': '/dev/sde'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1958567919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1958567919',id=37,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-ggx4g40y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:03:40Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=82177488-87bb-4e64-9653-99f01b080ec0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "vif_mac": "fa:16:3e:2d:0c:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "vif_mac": "fa:16:3e:2d:0c:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'pci_devices' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.objects.base [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Object Instance<82177488-87bb-4e64-9653-99f01b080ec0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:04:54 user nova-compute[74261]:   <uuid>82177488-87bb-4e64-9653-99f01b080ec0</uuid>
Oct 17 12:04:54 user nova-compute[74261]:   <name>instance-00000025</name>
Oct 17 12:04:54 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:04:54 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:04:54 user nova-compute[74261]:   <metadata>
Oct 17 12:04:54 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:04:54 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:04:54 user nova-compute[74261]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1958567919</nova:name>
Oct 17 12:04:54 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:04:54</nova:creationTime>
Oct 17 12:04:54 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:04:54 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:04:54 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:04:54 user nova-compute[74261]:       <nova:owner>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:user uuid="19d191be36a54216a9e2d6a64660e582">tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member</nova:user>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:project uuid="022b95f3129c4493b0a69149e5b8dd4e">tempest-ServerBootFromVolumeStableRescueTest-1400453141</nova:project>
Oct 17 12:04:54 user nova-compute[74261]:       </nova:owner>
Oct 17 12:04:54 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:04:54 user nova-compute[74261]:       <nova:ports>
Oct 17 12:04:54 user nova-compute[74261]:         <nova:port uuid="2f64c965-25b5-415a-9405-d51308c7243f">
Oct 17 12:04:54 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 12:04:54 user nova-compute[74261]:         </nova:port>
Oct 17 12:04:54 user nova-compute[74261]:       </nova:ports>
Oct 17 12:04:54 user nova-compute[74261]:     </nova:instance>
Oct 17 12:04:54 user nova-compute[74261]:   </metadata>
Oct 17 12:04:54 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:04:54 user nova-compute[74261]:     <system>
Oct 17 12:04:54 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:04:54 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:04:54 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:04:54 user nova-compute[74261]:       <entry name="serial">82177488-87bb-4e64-9653-99f01b080ec0</entry>
Oct 17 12:04:54 user nova-compute[74261]:       <entry name="uuid">82177488-87bb-4e64-9653-99f01b080ec0</entry>
Oct 17 12:04:54 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:04:54 user nova-compute[74261]:     </system>
Oct 17 12:04:54 user nova-compute[74261]:   </sysinfo>
Oct 17 12:04:54 user nova-compute[74261]:   <os>
Oct 17 12:04:54 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:04:54 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:04:54 user nova-compute[74261]:   </os>
Oct 17 12:04:54 user nova-compute[74261]:   <features>
Oct 17 12:04:54 user nova-compute[74261]:     <acpi/>
Oct 17 12:04:54 user nova-compute[74261]:     <apic/>
Oct 17 12:04:54 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:04:54 user nova-compute[74261]:   </features>
Oct 17 12:04:54 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:04:54 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:04:54 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:04:54 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:04:54 user nova-compute[74261]:   </clock>
Oct 17 12:04:54 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:04:54 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:04:54 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:04:54 user nova-compute[74261]:   </cpu>
Oct 17 12:04:54 user nova-compute[74261]:   <devices>
Oct 17 12:04:54 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:04:54 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:04:54 user nova-compute[74261]:       <source dev="/dev/sde"/>
Oct 17 12:04:54 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:04:54 user nova-compute[74261]:       <serial>26bc3d98-c013-449a-af6d-4dee21acf15c</serial>
Oct 17 12:04:54 user nova-compute[74261]:     </disk>
Oct 17 12:04:54 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:04:54 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:04:54 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue"/>
Oct 17 12:04:54 user nova-compute[74261]:       <target dev="vdb" bus="virtio"/>
Oct 17 12:04:54 user nova-compute[74261]:       <boot order="1"/>
Oct 17 12:04:54 user nova-compute[74261]:     </disk>
Oct 17 12:04:54 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:04:54 user nova-compute[74261]:       <mac address="fa:16:3e:2d:0c:f7"/>
Oct 17 12:04:54 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:04:54 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:04:54 user nova-compute[74261]:       <target dev="tap2f64c965-25"/>
Oct 17 12:04:54 user nova-compute[74261]:     </interface>
Oct 17 12:04:54 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:04:54 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/console.log" append="off"/>
Oct 17 12:04:54 user nova-compute[74261]:     </serial>
Oct 17 12:04:54 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:04:54 user nova-compute[74261]:     <video>
Oct 17 12:04:54 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:04:54 user nova-compute[74261]:     </video>
Oct 17 12:04:54 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:04:54 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:04:54 user nova-compute[74261]:     </rng>
Oct 17 12:04:54 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:04:54 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:04:54 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:04:54 user nova-compute[74261]:     </memballoon>
Oct 17 12:04:54 user nova-compute[74261]:   </devices>
Oct 17 12:04:54 user nova-compute[74261]: </domain>
Oct 17 12:04:54 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:04:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance destroyed successfully.
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:04:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] No VIF found with MAC fa:16:3e:2d:0c:f7, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-76adb1e5-362d-435e-a201-b5fa0c569f91 req-7aad71f2-6e52-4b55-8b2d-0bd2f309493f service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-76adb1e5-362d-435e-a201-b5fa0c569f91 req-7aad71f2-6e52-4b55-8b2d-0bd2f309493f service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-76adb1e5-362d-435e-a201-b5fa0c569f91 req-7aad71f2-6e52-4b55-8b2d-0bd2f309493f service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-76adb1e5-362d-435e-a201-b5fa0c569f91 req-7aad71f2-6e52-4b55-8b2d-0bd2f309493f service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:56 user nova-compute[74261]: DEBUG nova.compute.manager [req-76adb1e5-362d-435e-a201-b5fa0c569f91 req-7aad71f2-6e52-4b55-8b2d-0bd2f309493f service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:56 user nova-compute[74261]: WARNING nova.compute.manager [req-76adb1e5-362d-435e-a201-b5fa0c569f91 req-7aad71f2-6e52-4b55-8b2d-0bd2f309493f service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:04:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-4efa07e1-c9de-42ea-a6c1-bd186ba230cf req-d6125a57-8821-49cc-b2ea-6c0eb8ccbaa9 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:04:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4efa07e1-c9de-42ea-a6c1-bd186ba230cf req-d6125a57-8821-49cc-b2ea-6c0eb8ccbaa9 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:04:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4efa07e1-c9de-42ea-a6c1-bd186ba230cf req-d6125a57-8821-49cc-b2ea-6c0eb8ccbaa9 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:04:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4efa07e1-c9de-42ea-a6c1-bd186ba230cf req-d6125a57-8821-49cc-b2ea-6c0eb8ccbaa9 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:04:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-4efa07e1-c9de-42ea-a6c1-bd186ba230cf req-d6125a57-8821-49cc-b2ea-6c0eb8ccbaa9 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:04:58 user nova-compute[74261]: WARNING nova.compute.manager [req-4efa07e1-c9de-42ea-a6c1-bd186ba230cf req-d6125a57-8821-49cc-b2ea-6c0eb8ccbaa9 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state rescuing.
Oct 17 12:04:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f2ee070f-0366-4aad-9000-5547f34d089f tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:04:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:05:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:05:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:05:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:05:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:05:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8196MB free_disk=25.024005889892578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a590a88c-15ce-478b-976d-7e1828eee2bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 82177488-87bb-4e64-9653-99f01b080ec0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7c9b0f63-db8b-4314-b916-56e9dc65b675 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:05:13 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:05:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:05:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:05:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:05:19 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [{"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-dac3f877-dbbe-4593-b1a8-4c13b7c3382e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:05:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:05:21 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:05:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:05:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:46 user nova-compute[74261]: INFO nova.compute.manager [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Terminating instance
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:05:46 user nova-compute[74261]: INFO nova.compute.claims [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Claim successful on node user
Oct 17 12:05:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-cce20477-08cc-4609-bae5-4dbb3dbacc00 req-fc7929e3-eefb-4387-ad27-6a233788fcfb service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-unplugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cce20477-08cc-4609-bae5-4dbb3dbacc00 req-fc7929e3-eefb-4387-ad27-6a233788fcfb service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cce20477-08cc-4609-bae5-4dbb3dbacc00 req-fc7929e3-eefb-4387-ad27-6a233788fcfb service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-cce20477-08cc-4609-bae5-4dbb3dbacc00 req-fc7929e3-eefb-4387-ad27-6a233788fcfb service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-cce20477-08cc-4609-bae5-4dbb3dbacc00 req-fc7929e3-eefb-4387-ad27-6a233788fcfb service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-unplugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-cce20477-08cc-4609-bae5-4dbb3dbacc00 req-fc7929e3-eefb-4387-ad27-6a233788fcfb service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-unplugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:05:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:05:46 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.policy [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b58f7d968afe43dba578c46afe76a2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06657771107947418c199d9955a9c2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:05:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Instance destroyed successfully.
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'resources' on Instance uuid a590a88c-15ce-478b-976d-7e1828eee2bf {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132186004',display_name='tempest-ServerRescueNegativeTestJSON-server-1132186004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132186004',id=17,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-4ah40h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:50:58Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=a590a88c-15ce-478b-976d-7e1828eee2bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "address": "fa:16:3e:c3:42:eb", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6fdc01-fd", "ovs_interfaceid": "5c6fdc01-fdc1-486e-8e4f-f639d75dee12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG os_vif [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c6fdc01-fd, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dad76601-9984-4969-a46c-69782344a8d5) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:47 user nova-compute[74261]: INFO os_vif [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=5c6fdc01-fdc1-486e-8e4f-f639d75dee12,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6fdc01-fd')
Oct 17 12:05:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Deleting instance files /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf_del
Oct 17 12:05:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Deletion of /opt/stack/data/nova/instances/a590a88c-15ce-478b-976d-7e1828eee2bf_del complete
Oct 17 12:05:47 user nova-compute[74261]: INFO nova.compute.manager [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:05:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Creating image(s)
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "/opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "/opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk 1073741824" returned: 0 in 0.077s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Successfully created port: f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:05:47 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Took 0.62 seconds to deallocate network for instance.
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-abf126f9-8f2f-4aa1-b8fa-ab3529deda40 req-a560d117-8579-4dd1-aea2-4251b32445df service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-deleted-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.204s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:05:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Cannot resize image /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Ensure instance console log exists: /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:48 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Deleted allocations for instance a590a88c-15ce-478b-976d-7e1828eee2bf
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8002b011-c8d2-434e-b9a8-af80d6a374c9 tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Successfully updated port: f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquired lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] Acquiring lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] Lock "a590a88c-15ce-478b-976d-7e1828eee2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] No waiting events found dispatching network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:05:48 user nova-compute[74261]: WARNING nova.compute.manager [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: a590a88c-15ce-478b-976d-7e1828eee2bf] Received unexpected event network-vif-plugged-5c6fdc01-fdc1-486e-8e4f-f639d75dee12 for instance with vm_state deleted and task_state None.
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-changed-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Refreshing instance network info cache due to event network-changed-f4837a8f-5700-4e4f-8b8f-371d09689fb1. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] Acquiring lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updating instance_info_cache with network_info: [{"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Releasing lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Instance network_info: |[{"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] Acquired lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.neutron [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Refreshing network info cache for port f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Start _get_guest_xml network_info=[{"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:05:48 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:05:48 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1297016953',display_name='tempest-TestServerVolumeAttachmentScenario-server-1297016953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1297016953',id=38,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOz3/9jGVPl2TgmSu0XSPRh6ppvIxZeoNwdkL2uxhUvAOIVw0fgkVZPdfsY+Hk775cblwkgrgAv31k7aik5jVP4b+Br20Xg2L4VlVF/+Ructz95q/7W9Go0WGbXG1x2cGQ==',key_name='tempest-keypair-1519646987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06657771107947418c199d9955a9c2f5',ramdisk_id='',reservation_id='r-y3ivjndf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-96207815',owner_user_name='tempest-TestServerVolumeAttachmentScenario-96207815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b58f7d968afe43dba578c46afe76a2cc',uuid=7a1735a7-236f-4da4-b2a1-63c40d175b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Converting VIF {"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:05:48 user nova-compute[74261]:   <uuid>7a1735a7-236f-4da4-b2a1-63c40d175b51</uuid>
Oct 17 12:05:48 user nova-compute[74261]:   <name>instance-00000026</name>
Oct 17 12:05:48 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:05:48 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:05:48 user nova-compute[74261]:   <metadata>
Oct 17 12:05:48 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:05:48 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:05:48 user nova-compute[74261]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1297016953</nova:name>
Oct 17 12:05:48 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:05:48</nova:creationTime>
Oct 17 12:05:48 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:05:48 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:05:48 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:05:48 user nova-compute[74261]:       <nova:owner>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:user uuid="b58f7d968afe43dba578c46afe76a2cc">tempest-TestServerVolumeAttachmentScenario-96207815-project-member</nova:user>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:project uuid="06657771107947418c199d9955a9c2f5">tempest-TestServerVolumeAttachmentScenario-96207815</nova:project>
Oct 17 12:05:48 user nova-compute[74261]:       </nova:owner>
Oct 17 12:05:48 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:05:48 user nova-compute[74261]:       <nova:ports>
Oct 17 12:05:48 user nova-compute[74261]:         <nova:port uuid="f4837a8f-5700-4e4f-8b8f-371d09689fb1">
Oct 17 12:05:48 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 12:05:48 user nova-compute[74261]:         </nova:port>
Oct 17 12:05:48 user nova-compute[74261]:       </nova:ports>
Oct 17 12:05:48 user nova-compute[74261]:     </nova:instance>
Oct 17 12:05:48 user nova-compute[74261]:   </metadata>
Oct 17 12:05:48 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:05:48 user nova-compute[74261]:     <system>
Oct 17 12:05:48 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:05:48 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:05:48 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:05:48 user nova-compute[74261]:       <entry name="serial">7a1735a7-236f-4da4-b2a1-63c40d175b51</entry>
Oct 17 12:05:48 user nova-compute[74261]:       <entry name="uuid">7a1735a7-236f-4da4-b2a1-63c40d175b51</entry>
Oct 17 12:05:48 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:05:48 user nova-compute[74261]:     </system>
Oct 17 12:05:48 user nova-compute[74261]:   </sysinfo>
Oct 17 12:05:48 user nova-compute[74261]:   <os>
Oct 17 12:05:48 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:05:48 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:05:48 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:05:48 user nova-compute[74261]:   </os>
Oct 17 12:05:48 user nova-compute[74261]:   <features>
Oct 17 12:05:48 user nova-compute[74261]:     <acpi/>
Oct 17 12:05:48 user nova-compute[74261]:     <apic/>
Oct 17 12:05:48 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:05:48 user nova-compute[74261]:   </features>
Oct 17 12:05:48 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:05:48 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:05:48 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:05:48 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:05:48 user nova-compute[74261]:   </clock>
Oct 17 12:05:48 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:05:48 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:05:48 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:05:48 user nova-compute[74261]:   </cpu>
Oct 17 12:05:48 user nova-compute[74261]:   <devices>
Oct 17 12:05:48 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:05:48 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:05:48 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk"/>
Oct 17 12:05:48 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:05:48 user nova-compute[74261]:     </disk>
Oct 17 12:05:48 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:05:48 user nova-compute[74261]:       <mac address="fa:16:3e:2c:c2:b6"/>
Oct 17 12:05:48 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:05:48 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:05:48 user nova-compute[74261]:       <target dev="tapf4837a8f-57"/>
Oct 17 12:05:48 user nova-compute[74261]:     </interface>
Oct 17 12:05:48 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:05:48 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/console.log" append="off"/>
Oct 17 12:05:48 user nova-compute[74261]:     </serial>
Oct 17 12:05:48 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:05:48 user nova-compute[74261]:     <video>
Oct 17 12:05:48 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:05:48 user nova-compute[74261]:     </video>
Oct 17 12:05:48 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:05:48 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:05:48 user nova-compute[74261]:     </rng>
Oct 17 12:05:48 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:05:48 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:05:48 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:05:48 user nova-compute[74261]:     </memballoon>
Oct 17 12:05:48 user nova-compute[74261]:   </devices>
Oct 17 12:05:48 user nova-compute[74261]: </domain>
Oct 17 12:05:48 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1297016953',display_name='tempest-TestServerVolumeAttachmentScenario-server-1297016953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1297016953',id=38,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOz3/9jGVPl2TgmSu0XSPRh6ppvIxZeoNwdkL2uxhUvAOIVw0fgkVZPdfsY+Hk775cblwkgrgAv31k7aik5jVP4b+Br20Xg2L4VlVF/+Ructz95q/7W9Go0WGbXG1x2cGQ==',key_name='tempest-keypair-1519646987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06657771107947418c199d9955a9c2f5',ramdisk_id='',reservation_id='r-y3ivjndf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-96207815',owner_user_name='tempest-TestServerVolumeAttachmentScenario-96207815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b58f7d968afe43dba578c46afe76a2cc',uuid=7a1735a7-236f-4da4-b2a1-63c40d175b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Converting VIF {"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG os_vif [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '091ab5a1-a612-5b68-aa7b-8e8924ac05da', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4837a8f-57, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4837a8f-57, col_values=(('qos', UUID('30909e46-bb3f-4f98-99c2-f6500dcb51f0')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4837a8f-57, col_values=(('external_ids', {'iface-id': 'f4837a8f-5700-4e4f-8b8f-371d09689fb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:c2:b6', 'vm-uuid': '7a1735a7-236f-4da4-b2a1-63c40d175b51'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:05:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:49 user nova-compute[74261]: INFO os_vif [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57')
Oct 17 12:05:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:05:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No VIF found with MAC fa:16:3e:2c:c2:b6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:05:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updated VIF entry in instance network info cache for port f4837a8f-5700-4e4f-8b8f-371d09689fb1. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:05:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updating instance_info_cache with network_info: [{"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:05:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c148aea4-2823-4237-82a6-a5429c74a3c6 req-da4e8265-300e-439a-b1e6-c9fa4ece53b9 service nova] Releasing lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-a53838d2-9470-4e7b-a6ee-dffd5e2a2abe req-7b0361a1-e925-41bc-adcf-aba703ce369e service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a53838d2-9470-4e7b-a6ee-dffd5e2a2abe req-7b0361a1-e925-41bc-adcf-aba703ce369e service nova] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a53838d2-9470-4e7b-a6ee-dffd5e2a2abe req-7b0361a1-e925-41bc-adcf-aba703ce369e service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a53838d2-9470-4e7b-a6ee-dffd5e2a2abe req-7b0361a1-e925-41bc-adcf-aba703ce369e service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-a53838d2-9470-4e7b-a6ee-dffd5e2a2abe req-7b0361a1-e925-41bc-adcf-aba703ce369e service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] No waiting events found dispatching network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:05:50 user nova-compute[74261]: WARNING nova.compute.manager [req-a53838d2-9470-4e7b-a6ee-dffd5e2a2abe req-7b0361a1-e925-41bc-adcf-aba703ce369e service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received unexpected event network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 for instance with vm_state building and task_state spawning.
Oct 17 12:05:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-5cec3170-8b9a-4b50-b37c-fecd35c71a80 req-8eeb23e8-424b-4441-be12-b02a4a2a08f6 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5cec3170-8b9a-4b50-b37c-fecd35c71a80 req-8eeb23e8-424b-4441-be12-b02a4a2a08f6 service nova] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5cec3170-8b9a-4b50-b37c-fecd35c71a80 req-8eeb23e8-424b-4441-be12-b02a4a2a08f6 service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5cec3170-8b9a-4b50-b37c-fecd35c71a80 req-8eeb23e8-424b-4441-be12-b02a4a2a08f6 service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-5cec3170-8b9a-4b50-b37c-fecd35c71a80 req-8eeb23e8-424b-4441-be12-b02a4a2a08f6 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] No waiting events found dispatching network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:05:52 user nova-compute[74261]: WARNING nova.compute.manager [req-5cec3170-8b9a-4b50-b37c-fecd35c71a80 req-8eeb23e8-424b-4441-be12-b02a4a2a08f6 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received unexpected event network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 for instance with vm_state building and task_state spawning.
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:05:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Instance spawned successfully.
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:05:52 user nova-compute[74261]: INFO nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Took 5.77 seconds to spawn the instance on the hypervisor.
Oct 17 12:05:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:05:53 user nova-compute[74261]: INFO nova.compute.manager [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Took 7.02 seconds to build instance.
Oct 17 12:05:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-873cec60-97f5-4f34-b0c5-3ed740f06fe4 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.128s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:58 user nova-compute[74261]: INFO nova.compute.manager [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Terminating instance
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-c2c0b6ee-7c5f-4041-9fe7-d681620e437e req-b6dcad49-60a1-4ad1-bd71-bbf74858bed8 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-unplugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c2c0b6ee-7c5f-4041-9fe7-d681620e437e req-b6dcad49-60a1-4ad1-bd71-bbf74858bed8 service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c2c0b6ee-7c5f-4041-9fe7-d681620e437e req-b6dcad49-60a1-4ad1-bd71-bbf74858bed8 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c2c0b6ee-7c5f-4041-9fe7-d681620e437e req-b6dcad49-60a1-4ad1-bd71-bbf74858bed8 service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-c2c0b6ee-7c5f-4041-9fe7-d681620e437e req-b6dcad49-60a1-4ad1-bd71-bbf74858bed8 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-unplugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.compute.manager [req-c2c0b6ee-7c5f-4041-9fe7-d681620e437e req-b6dcad49-60a1-4ad1-bd71-bbf74858bed8 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-unplugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:05:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Instance destroyed successfully.
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lazy-loading 'resources' on Instance uuid 7c9b0f63-db8b-4314-b916-56e9dc65b675 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T12:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-150427143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-150427143',id=34,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWjS+gY4aAH9DctNbNzzJABZRomTsctDrQNMZiAmKKGFO/0jB+KMeJj9hXxFhroWX9C3bLFdBngA195hhAZPaDKEeJsnclim8fbwnLrI7vYLQmzIs98EGg0g/n1Top0Yg==',key_name='tempest-keypair-817985384',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:04:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117fbb67e9764c1e9e3211ba9a08b864',ramdisk_id='',reservation_id='r-ua1yvbj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-63868510',owner_user_name='tempest-AttachVolumeShelveTestJSON-63868510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229ff57765914e75a370db408f67c501',uuid=7c9b0f63-db8b-4314-b916-56e9dc65b675,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converting VIF {"id": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "address": "fa:16:3e:fb:4d:b3", "network": {"id": "053a435e-c3df-4c14-93ab-1d4db548fbe6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1633309416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117fbb67e9764c1e9e3211ba9a08b864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b27ad8-3d", "ovs_interfaceid": "d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG os_vif [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4b27ad8-3d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59535ed8-468e-452e-bbc4-cb77716a59d9) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:05:58 user nova-compute[74261]: INFO os_vif [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17,network=Network(053a435e-c3df-4c14-93ab-1d4db548fbe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b27ad8-3d')
Oct 17 12:05:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Deleting instance files /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675_del
Oct 17 12:05:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Deletion of /opt/stack/data/nova/instances/7c9b0f63-db8b-4314-b916-56e9dc65b675_del complete
Oct 17 12:05:58 user nova-compute[74261]: INFO nova.compute.manager [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 17 12:05:58 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:05:58 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:05:59 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:05:59 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Took 0.88 seconds to deallocate network for instance.
Oct 17 12:05:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-550a2b85-9bbe-4fc7-8022-2976464680ab req-d82e82e3-76fc-4576-8204-51642096b999 service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-deleted-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:05:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:05:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:00 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Deleted allocations for instance 7c9b0f63-db8b-4314-b916-56e9dc65b675
Oct 17 12:06:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e807666b-980e-4987-813d-28c6396a1c54 tempest-AttachVolumeShelveTestJSON-63868510 tempest-AttachVolumeShelveTestJSON-63868510-project-member] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.358s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG nova.compute.manager [req-723eac4c-a992-44d7-9dc9-1468c8396077 req-f7395203-5981-4dde-8ed7-d3d53ed59c1f service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-723eac4c-a992-44d7-9dc9-1468c8396077 req-f7395203-5981-4dde-8ed7-d3d53ed59c1f service nova] Acquiring lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-723eac4c-a992-44d7-9dc9-1468c8396077 req-f7395203-5981-4dde-8ed7-d3d53ed59c1f service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-723eac4c-a992-44d7-9dc9-1468c8396077 req-f7395203-5981-4dde-8ed7-d3d53ed59c1f service nova] Lock "7c9b0f63-db8b-4314-b916-56e9dc65b675-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:00 user nova-compute[74261]: DEBUG nova.compute.manager [req-723eac4c-a992-44d7-9dc9-1468c8396077 req-f7395203-5981-4dde-8ed7-d3d53ed59c1f service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] No waiting events found dispatching network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:00 user nova-compute[74261]: WARNING nova.compute.manager [req-723eac4c-a992-44d7-9dc9-1468c8396077 req-f7395203-5981-4dde-8ed7-d3d53ed59c1f service nova] [instance: 7c9b0f63-db8b-4314-b916-56e9dc65b675] Received unexpected event network-vif-plugged-d4b27ad8-3d9d-4ac5-9195-7f7ed7d22f17 for instance with vm_state deleted and task_state None.
Oct 17 12:06:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:06:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:06:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:06:12 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=25.039966583251953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 82177488-87bb-4e64-9653-99f01b080ec0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:06:12 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:06:13 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:06:13 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:06:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:06:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:06:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:06:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:06:21 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:06:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:06:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:06:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:06:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:06:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:36 user nova-compute[74261]: INFO nova.compute.manager [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Terminating instance
Oct 17 12:06:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-8e5df112-ce2f-47e8-81ff-1889b8c65de9 req-f021ed79-bae5-4ee0-a304-30a164b1a17d service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8e5df112-ce2f-47e8-81ff-1889b8c65de9 req-f021ed79-bae5-4ee0-a304-30a164b1a17d service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8e5df112-ce2f-47e8-81ff-1889b8c65de9 req-f021ed79-bae5-4ee0-a304-30a164b1a17d service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8e5df112-ce2f-47e8-81ff-1889b8c65de9 req-f021ed79-bae5-4ee0-a304-30a164b1a17d service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-8e5df112-ce2f-47e8-81ff-1889b8c65de9 req-f021ed79-bae5-4ee0-a304-30a164b1a17d service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-8e5df112-ce2f-47e8-81ff-1889b8c65de9 req-f021ed79-bae5-4ee0-a304-30a164b1a17d service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-unplugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:06:37 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Instance destroyed successfully.
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.objects.instance [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lazy-loading 'resources' on Instance uuid dac3f877-dbbe-4593-b1a8-4c13b7c3382e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-108849629',display_name='tempest-ServerRescueNegativeTestJSON-server-108849629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-108849629',id=16,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0a71e6e0274702b67351ba09b91c7f',ramdisk_id='',reservation_id='r-1l47gkmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1673978463',owner_user_name='tempest-ServerRescueNegativeTestJSON-1673978463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:55:45Z,user_data=None,user_id='171d1037b5b74e09812373e40ef7c193',uuid=dac3f877-dbbe-4593-b1a8-4c13b7c3382e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converting VIF {"id": "03525b1a-3365-4e16-a0f9-254421d22c50", "address": "fa:16:3e:6e:2b:3d", "network": {"id": "440471d6-f1d4-478f-88b8-8419c8bef4e9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1300374224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0a71e6e0274702b67351ba09b91c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03525b1a-33", "ovs_interfaceid": "03525b1a-3365-4e16-a0f9-254421d22c50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG os_vif [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03525b1a-33, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd5e0591-f843-4886-9ea6-9879db1852f5) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:37 user nova-compute[74261]: INFO os_vif [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2b:3d,bridge_name='br-int',has_traffic_filtering=True,id=03525b1a-3365-4e16-a0f9-254421d22c50,network=Network(440471d6-f1d4-478f-88b8-8419c8bef4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03525b1a-33')
Oct 17 12:06:37 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Deleting instance files /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e_del
Oct 17 12:06:37 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Deletion of /opt/stack/data/nova/instances/dac3f877-dbbe-4593-b1a8-4c13b7c3382e_del complete
Oct 17 12:06:37 user nova-compute[74261]: INFO nova.compute.manager [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 17 12:06:37 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:06:37 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:06:38 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Took 0.56 seconds to deallocate network for instance.
Oct 17 12:06:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-72ebaa57-9ec6-4322-9513-eb59d24478dc req-317de58e-c736-4910-8a9e-797f1f8da74e service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-deleted-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:38 user nova-compute[74261]: INFO nova.compute.manager [req-72ebaa57-9ec6-4322-9513-eb59d24478dc req-317de58e-c736-4910-8a9e-797f1f8da74e service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Neutron deleted interface 03525b1a-3365-4e16-a0f9-254421d22c50; detaching it from the instance and deleting it from the info cache
Oct 17 12:06:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-72ebaa57-9ec6-4322-9513-eb59d24478dc req-317de58e-c736-4910-8a9e-797f1f8da74e service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-72ebaa57-9ec6-4322-9513-eb59d24478dc req-317de58e-c736-4910-8a9e-797f1f8da74e service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Detach interface failed, port_id=03525b1a-3365-4e16-a0f9-254421d22c50, reason: Instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:06:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:38 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Deleted allocations for instance dac3f877-dbbe-4593-b1a8-4c13b7c3382e
Oct 17 12:06:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fe87a74a-ee9e-4924-8fde-638ad0bcb2cc tempest-ServerRescueNegativeTestJSON-1673978463 tempest-ServerRescueNegativeTestJSON-1673978463-project-member] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-f0312ee2-e9dc-4b4d-bc67-ca404110172a req-ac35fdec-159f-4002-af51-70224f497af2 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f0312ee2-e9dc-4b4d-bc67-ca404110172a req-ac35fdec-159f-4002-af51-70224f497af2 service nova] Acquiring lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f0312ee2-e9dc-4b4d-bc67-ca404110172a req-ac35fdec-159f-4002-af51-70224f497af2 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f0312ee2-e9dc-4b4d-bc67-ca404110172a req-ac35fdec-159f-4002-af51-70224f497af2 service nova] Lock "dac3f877-dbbe-4593-b1a8-4c13b7c3382e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-f0312ee2-e9dc-4b4d-bc67-ca404110172a req-ac35fdec-159f-4002-af51-70224f497af2 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] No waiting events found dispatching network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:39 user nova-compute[74261]: WARNING nova.compute.manager [req-f0312ee2-e9dc-4b4d-bc67-ca404110172a req-ac35fdec-159f-4002-af51-70224f497af2 service nova] [instance: dac3f877-dbbe-4593-b1a8-4c13b7c3382e] Received unexpected event network-vif-plugged-03525b1a-3365-4e16-a0f9-254421d22c50 for instance with vm_state deleted and task_state None.
Oct 17 12:06:42 user nova-compute[74261]: INFO nova.compute.manager [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Unrescuing
Oct 17 12:06:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquired lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating instance_info_cache with network_info: [{"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Releasing lock "refresh_cache-82177488-87bb-4e64-9653-99f01b080ec0" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'flavor' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-73d247dc-e53c-49ac-bc87-96a481bf8e3b req-5c38c652-a780-4b41-a6d2-b16a7de28eb7 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-73d247dc-e53c-49ac-bc87-96a481bf8e3b req-5c38c652-a780-4b41-a6d2-b16a7de28eb7 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-73d247dc-e53c-49ac-bc87-96a481bf8e3b req-5c38c652-a780-4b41-a6d2-b16a7de28eb7 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-73d247dc-e53c-49ac-bc87-96a481bf8e3b req-5c38c652-a780-4b41-a6d2-b16a7de28eb7 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-73d247dc-e53c-49ac-bc87-96a481bf8e3b req-5c38c652-a780-4b41-a6d2-b16a7de28eb7 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:42 user nova-compute[74261]: WARNING nova.compute.manager [req-73d247dc-e53c-49ac-bc87-96a481bf8e3b req-5c38c652-a780-4b41-a6d2-b16a7de28eb7 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state rescued and task_state unrescuing.
Oct 17 12:06:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:43 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance destroyed successfully.
Oct 17 12:06:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:44 user nova-compute[74261]: WARNING nova.compute.manager [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state rescued and task_state unrescuing.
Oct 17 12:06:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:44 user nova-compute[74261]: DEBUG nova.compute.manager [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:44 user nova-compute[74261]: WARNING nova.compute.manager [req-6efb5934-fa1f-4e73-8542-6ccde30d8994 req-bab2fdbd-1fd8-49c3-9aa9-7484c1462eb2 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state rescued and task_state unrescuing.
Oct 17 12:06:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-687fe009-8b9b-4333-b066-fca351bafe22 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ce17f47-849b-45e0-89d4-33f2f2fb89d4 req-e01adf71-c7be-441c-bb63-2993ba4cb251 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ce17f47-849b-45e0-89d4-33f2f2fb89d4 req-e01adf71-c7be-441c-bb63-2993ba4cb251 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ce17f47-849b-45e0-89d4-33f2f2fb89d4 req-e01adf71-c7be-441c-bb63-2993ba4cb251 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ce17f47-849b-45e0-89d4-33f2f2fb89d4 req-e01adf71-c7be-441c-bb63-2993ba4cb251 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:06:46 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ce17f47-849b-45e0-89d4-33f2f2fb89d4 req-e01adf71-c7be-441c-bb63-2993ba4cb251 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:06:46 user nova-compute[74261]: WARNING nova.compute.manager [req-7ce17f47-849b-45e0-89d4-33f2f2fb89d4 req-e01adf71-c7be-441c-bb63-2993ba4cb251 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state None.
Oct 17 12:06:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:06:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:07:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:12 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:07:13 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=25.05609893798828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 82177488-87bb-4e64-9653-99f01b080ec0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:07:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:07:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:17 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [{"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7d774988-6ac5-4701-a34e-64b99df1687e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:21 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:07:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-changed-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:07:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Refreshing instance network info cache due to event network-changed-f4837a8f-5700-4e4f-8b8f-371d09689fb1. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:07:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] Acquiring lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:07:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] Acquired lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:07:37 user nova-compute[74261]: DEBUG nova.network.neutron [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Refreshing network info cache for port f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:07:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updated VIF entry in instance network info cache for port f4837a8f-5700-4e4f-8b8f-371d09689fb1. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updating instance_info_cache with network_info: [{"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7146785a-37a2-4f78-9644-d0ae6c2baeb5 req-0f130e1c-75d4-44f6-b05f-d0971a8f9cdb service nova] Releasing lock "refresh_cache-7a1735a7-236f-4da4-b2a1-63c40d175b51" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'flavor' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:07:38 user nova-compute[74261]: INFO nova.compute.manager [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attaching volume 2161ca84-95ec-4297-9865-3474f96a12d4 to /dev/vdb
Oct 17 12:07:38 user nova-compute[74261]: DEBUG os_brick.utils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c84cd08-3358-4427-a136-057cbeb98c0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d26f40-cca1-4176-992d-592e0aa35618]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2809dc7-33c7-4762-b72c-68057f141c62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9a87ec-138a-48f1-90a8-27d511d8b406]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:07:38 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:07:38 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf764e8-f34d-497e-a6c9-8d6c2f10121f]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG os_brick.utils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:07:38 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updating existing volume attachment record: 0a54389f-11c5-44da-b003-8f463e69d62f {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:07:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzsatVYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:07:56 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:07:56 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:07:56 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff9c906-9556-470c-8860-91c710722cc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:07:56 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f2d01-f261-48f6-b911-ab61e1ad2045]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4] added
Oct 17 12:07:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626846f-9895-4c9f-b830-316d65c0bf77]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e081454-1b77-49ba-8097-39dcac14c7b0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzsatVYE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzsatVYE" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6fe4c7-a25a-49bb-9aa7-bd8ea4969892]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HzsatVYE'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9d1de-8d85-4103-8d5e-567b20963742]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b98bc-bb64-4cbf-b622-88c5a90f7322]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:07:56 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:07:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:07:56 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:07:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f6afc-215e-48d2-b1c9-d410af316ff6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260]
Oct 17 12:07:56 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260] successful.
Oct 17 12:07:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90bdec9-1c99-4557-bc35-05f892592f7f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f0b260-c378-4fd8-9c28-c165beee0b97]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:07:56 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:07:56 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:07:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:07:56 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:07:56 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:07:56 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c9227-a1ba-4928-a575-bb3c794f930b]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:07:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzsatVYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23561346331383230', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561346331383230', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'flavor' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:07:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:07:57 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:07:57 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:07:57 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:07:57 user nova-compute[74261]:   <serial>2161ca84-95ec-4297-9865-3474f96a12d4</serial>
Oct 17 12:07:57 user nova-compute[74261]: </disk>
Oct 17 12:07:57 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:07:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:07:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:07:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No VIF found with MAC fa:16:3e:2c:c2:b6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:07:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b2c4f559-471d-4f84-a9ab-10e7b5c44664 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.663s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:07:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:07:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:07:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:08:00 user nova-compute[74261]: INFO nova.compute.claims [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Claim successful on node user
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:08:00 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:08:00 user nova-compute[74261]: INFO nova.virt.block_device [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Booting with volume 6dd8ffe3-9b66-4d52-b390-b364d8fc2fab at /dev/vda
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.policy [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '236acb378dd5414d9da0402b28550a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7d085514a94bc08f49773b28b92d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG os_brick.utils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332a209-c710-4844-ab9b-7cf2e395e2bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b0919-31b1-4c79-89ff-6aa7a5cd2d47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7b520a-ae83-4c99-8226-167b366eff12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7255df-248a-42d3-bde6-c1f82004a41f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:08:00 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:08:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ed843-1b61-4541-b487-f36b34a782fd]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG os_brick.utils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:08:00 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating existing volume attachment record: 3dcbac17-032b-4622-a0ee-0bc1d0ff218e {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:08:01 user nova-compute[74261]: DEBUG nova.network.neutron [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Successfully created port: 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'flavor' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:02 user nova-compute[74261]: INFO nova.compute.manager [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attaching volume 9f585801-749e-4701-bb24-c4684c1b4130 to /dev/vdc
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Successfully updated port: 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG os_brick.utils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing instance network info cache due to event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad36020-8c3e-423b-99eb-ebedee062674]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e5f3f9-d0d9-4ee4-b727-434d92ed7da1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ca805d-f99a-4b26-9897-471ac7ecae1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651957b-9c05-4b3d-814e-444bff28754f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:08:02 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbbb43-fca9-43ab-a3e6-d7383e76ddb2]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG os_brick.utils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updating existing volume attachment record: 2df8ceb3-a2f3-493f-9647-8fbfbdd074e2 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.network.neutron [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance network_info: |[{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:08:02 user nova-compute[74261]: DEBUG nova.network.neutron [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:08:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updated VIF entry in instance network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:08:03 user nova-compute[74261]: DEBUG nova.network.neutron [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:08:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-df82a3bf-b221-4ae2-afc3-eb84bbe65fc9 req-f7b2190c-8310-40e3-9836-2ce00237fdfe service nova] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:08:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:08:13 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:08:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:08:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8523MB free_disk=25.034591674804688GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 82177488-87bb-4e64-9653-99f01b080ec0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 85b00045-b0be-4a06-9930-3d2950bde8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:08:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:08:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Creating image(s)
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Ensure instance console log exists: /opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Start _get_guest_xml network_info=[{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '3dcbac17-032b-4622-a0ee-0bc1d0ff218e', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85b00045-b0be-4a06-9930-3d2950bde8a6', 'attached_at': '', 'detached_at': '', 'volume_id': '6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'serial': '6dd8ffe3-9b66-4d52-b390-b364d8fc2fab'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:08:19 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:08:19 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:08:19 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:08:19 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:08:19 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e2fc00-3ca5-48f9-938a-5697358a0f7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:08:19 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb4a95b-f8c9-4532-ab61-00856e5fa751]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab] added
Oct 17 12:08:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f0bc5-624f-408a-8535-2564699bb494]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8ee4c-2c3c-4b90-985f-30fae66424aa]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQKpnwEb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQKpnwEb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b80387f-0b9f-49ee-8545-9dc17dfe0726]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQKpnwEb'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67642f-5e41-4fd9-9d7b-4b169142b6ef]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a6c76-d0ca-44fb-8503-c0348f06f00f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3c5cb1-77ee-468c-aefd-8af641821031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]
Oct 17 12:08:19 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.
Oct 17 12:08:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4893fe9b-562d-43d9-91e7-ba20944ee2ab]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e89ec9-df52-456a-9542-e69e7a5bee9b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:19 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:19 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d9ed8-4c40-4783-ba38-91e8cfe9a155]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:19 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23433653238343863', 'path': '/dev/sdd'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433653238343863', 'path': '/dev/sdd'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DILZlCFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:08:20 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:08:20 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:08:20 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1063978881',display_name='tempest-TestShelveInstance-server-1063978881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1063978881',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrTUUeK6d576D9Wi7TY+mmNKRECFGNY6cDZ0WkMgsYIe3SVO+Je/Ha74c5BJoREGP2jz3v3y8VEpS+xufvGin7NbE+IB0xqAI7jEH6pIbRjrVdH61ocBm5U2vD06IMmUw==',key_name='tempest-TestShelveInstance-1798180429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b7d085514a94bc08f49773b28b92d86',ramdisk_id='',reservation_id='r-9co0384g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1038321046',owner_user_name='tempest-TestShelveInstance-1038321046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:08:01Z,user_data=None,user_id='236acb378dd5414d9da0402b28550a4f',uuid=85b00045-b0be-4a06-9930-3d2950bde8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converting VIF {"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.objects.instance [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e461fd-7324-4e11-aad0-4cc35d65abf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:08:20 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:08:20 user nova-compute[74261]:   <uuid>85b00045-b0be-4a06-9930-3d2950bde8a6</uuid>
Oct 17 12:08:20 user nova-compute[74261]:   <name>instance-00000027</name>
Oct 17 12:08:20 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:08:20 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:08:20 user nova-compute[74261]:   <metadata>
Oct 17 12:08:20 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:08:20 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:08:20 user nova-compute[74261]:       <nova:name>tempest-TestShelveInstance-server-1063978881</nova:name>
Oct 17 12:08:20 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:08:19</nova:creationTime>
Oct 17 12:08:20 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:08:20 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:08:20 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:08:20 user nova-compute[74261]:       <nova:owner>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:user uuid="236acb378dd5414d9da0402b28550a4f">tempest-TestShelveInstance-1038321046-project-member</nova:user>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:project uuid="2b7d085514a94bc08f49773b28b92d86">tempest-TestShelveInstance-1038321046</nova:project>
Oct 17 12:08:20 user nova-compute[74261]:       </nova:owner>
Oct 17 12:08:20 user nova-compute[74261]:       <nova:ports>
Oct 17 12:08:20 user nova-compute[74261]:         <nova:port uuid="793feba2-6044-4088-ada0-82adb93b9d3f">
Oct 17 12:08:20 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 12:08:20 user nova-compute[74261]:         </nova:port>
Oct 17 12:08:20 user nova-compute[74261]:       </nova:ports>
Oct 17 12:08:20 user nova-compute[74261]:     </nova:instance>
Oct 17 12:08:20 user nova-compute[74261]:   </metadata>
Oct 17 12:08:20 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:08:20 user nova-compute[74261]:     <system>
Oct 17 12:08:20 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:08:20 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:08:20 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:08:20 user nova-compute[74261]:       <entry name="serial">85b00045-b0be-4a06-9930-3d2950bde8a6</entry>
Oct 17 12:08:20 user nova-compute[74261]:       <entry name="uuid">85b00045-b0be-4a06-9930-3d2950bde8a6</entry>
Oct 17 12:08:20 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:08:20 user nova-compute[74261]:     </system>
Oct 17 12:08:20 user nova-compute[74261]:   </sysinfo>
Oct 17 12:08:20 user nova-compute[74261]:   <os>
Oct 17 12:08:20 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:08:20 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:08:20 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:08:20 user nova-compute[74261]:   </os>
Oct 17 12:08:20 user nova-compute[74261]:   <features>
Oct 17 12:08:20 user nova-compute[74261]:     <acpi/>
Oct 17 12:08:20 user nova-compute[74261]:     <apic/>
Oct 17 12:08:20 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:08:20 user nova-compute[74261]:   </features>
Oct 17 12:08:20 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:08:20 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:08:20 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:08:20 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:08:20 user nova-compute[74261]:   </clock>
Oct 17 12:08:20 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:08:20 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:08:20 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:08:20 user nova-compute[74261]:   </cpu>
Oct 17 12:08:20 user nova-compute[74261]:   <devices>
Oct 17 12:08:20 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:08:20 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:08:20 user nova-compute[74261]:       <source dev="/dev/sdd"/>
Oct 17 12:08:20 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:08:20 user nova-compute[74261]:       <serial>6dd8ffe3-9b66-4d52-b390-b364d8fc2fab</serial>
Oct 17 12:08:20 user nova-compute[74261]:     </disk>
Oct 17 12:08:20 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:08:20 user nova-compute[74261]:       <mac address="fa:16:3e:33:38:e6"/>
Oct 17 12:08:20 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:08:20 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:08:20 user nova-compute[74261]:       <target dev="tap793feba2-60"/>
Oct 17 12:08:20 user nova-compute[74261]:     </interface>
Oct 17 12:08:20 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:08:20 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6/console.log" append="off"/>
Oct 17 12:08:20 user nova-compute[74261]:     </serial>
Oct 17 12:08:20 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:08:20 user nova-compute[74261]:     <video>
Oct 17 12:08:20 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:08:20 user nova-compute[74261]:     </video>
Oct 17 12:08:20 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:08:20 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:08:20 user nova-compute[74261]:     </rng>
Oct 17 12:08:20 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:08:20 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:08:20 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:08:20 user nova-compute[74261]:     </memballoon>
Oct 17 12:08:20 user nova-compute[74261]:   </devices>
Oct 17 12:08:20 user nova-compute[74261]: </domain>
Oct 17 12:08:20 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1063978881',display_name='tempest-TestShelveInstance-server-1063978881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1063978881',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrTUUeK6d576D9Wi7TY+mmNKRECFGNY6cDZ0WkMgsYIe3SVO+Je/Ha74c5BJoREGP2jz3v3y8VEpS+xufvGin7NbE+IB0xqAI7jEH6pIbRjrVdH61ocBm5U2vD06IMmUw==',key_name='tempest-TestShelveInstance-1798180429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b7d085514a94bc08f49773b28b92d86',ramdisk_id='',reservation_id='r-9co0384g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1038321046',owner_user_name='tempest-TestShelveInstance-1038321046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:08:01Z,user_data=None,user_id='236acb378dd5414d9da0402b28550a4f',uuid=85b00045-b0be-4a06-9930-3d2950bde8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converting VIF {"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_vif [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228cabd-c932-4fbf-ba90-d6ac414a8b4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130] added
Oct 17 12:08:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1e2933a-b4cb-59fe-a28c-90cb1b35d6f6', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap793feba2-60, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap793feba2-60, col_values=(('qos', UUID('640e8b7a-8dab-430c-92b5-3b1093e5dc23')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap793feba2-60, col_values=(('external_ids', {'iface-id': '793feba2-6044-4088-ada0-82adb93b9d3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:38:e6', 'vm-uuid': '85b00045-b0be-4a06-9930-3d2950bde8a6'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:20 user nova-compute[74261]: INFO os_vif [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60')
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8f3977-56c7-40fb-a9a4-f6b000469b3c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d6892-e28f-4147-936b-94d2355fa9a2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DILZlCFO {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DILZlCFO" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d75ac-ba60-4bb5-803d-57e906e76ab4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DILZlCFO'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] No VIF found with MAC fa:16:3e:33:38:e6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[82151dee-9027-410f-82f0-047abe4a0ee7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc66093-78e3-4268-8cb8-1c029a4d8023]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[47652e52-412c-451b-80ba-ea38b460ab7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260]
Oct 17 12:08:20 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260] successful.
Oct 17 12:08:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac677ac-1047-4bd1-829f-79590df61747]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa16697-e2fd-4f2d-84cb-6e1fb16e6970]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:20 user nova-compute[74261]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)
Oct 17 12:08:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7db9a0-d0d4-4da7-b578-f4b394ba77e8]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:08:21 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:08:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DILZlCFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:08:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:08:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26633303064613430', 'path': '/dev/sdf'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:08:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633303064613430', 'path': '/dev/sdf'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:08:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'flavor' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:08:22 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:08:22 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 12:08:22 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 12:08:22 user nova-compute[74261]:   <serial>9f585801-749e-4701-bb24-c4684c1b4130</serial>
Oct 17 12:08:22 user nova-compute[74261]: </disk>
Oct 17 12:08:22 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9ad7f15-b062-4689-9b11-df91a9592d6f req-18dda308-5a80-4834-9c04-b2647afcc80c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9ad7f15-b062-4689-9b11-df91a9592d6f req-18dda308-5a80-4834-9c04-b2647afcc80c service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9ad7f15-b062-4689-9b11-df91a9592d6f req-18dda308-5a80-4834-9c04-b2647afcc80c service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b9ad7f15-b062-4689-9b11-df91a9592d6f req-18dda308-5a80-4834-9c04-b2647afcc80c service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.compute.manager [req-b9ad7f15-b062-4689-9b11-df91a9592d6f req-18dda308-5a80-4834-9c04-b2647afcc80c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:08:22 user nova-compute[74261]: WARNING nova.compute.manager [req-b9ad7f15-b062-4689-9b11-df91a9592d6f req-18dda308-5a80-4834-9c04-b2647afcc80c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state building and task_state spawning.
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] No VIF found with MAC fa:16:3e:2c:c2:b6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ae0b9010-e9df-4a5b-9b23-922add91d59c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.480s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:23 user nova-compute[74261]: INFO nova.compute.manager [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Detaching volume 9f585801-749e-4701-bb24-c4684c1b4130
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Updating instance_info_cache with network_info: [{"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:08:23 user nova-compute[74261]: INFO nova.virt.block_device [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attempting to driver detach volume 9f585801-749e-4701-bb24-c4684c1b4130 from mountpoint /dev/vdc
Oct 17 12:08:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-a4628ad3-6edb-4038-bba4-05421317e568" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Attempting to detach device vdc from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:08:23 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:08:23 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 12:08:23 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 12:08:23 user nova-compute[74261]:   <serial>9f585801-749e-4701-bb24-c4684c1b4130</serial>
Oct 17 12:08:23 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 12:08:23 user nova-compute[74261]: </disk>
Oct 17 12:08:23 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:08:23 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Successfully detached device vdc from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the persistent domain config.
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:08:23 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:08:23 user nova-compute[74261]:   <source dev="/dev/sdf"/>
Oct 17 12:08:23 user nova-compute[74261]:   <target dev="vdc" bus="virtio"/>
Oct 17 12:08:23 user nova-compute[74261]:   <serial>9f585801-749e-4701-bb24-c4684c1b4130</serial>
Oct 17 12:08:23 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 12:08:23 user nova-compute[74261]: </disk>
Oct 17 12:08:23 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-5733738d-a11d-4656-ae5e-9cc193b572aa req-bc019d5f-07a8-4510-b0da-a9e893eec9b3 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5733738d-a11d-4656-ae5e-9cc193b572aa req-bc019d5f-07a8-4510-b0da-a9e893eec9b3 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5733738d-a11d-4656-ae5e-9cc193b572aa req-bc019d5f-07a8-4510-b0da-a9e893eec9b3 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5733738d-a11d-4656-ae5e-9cc193b572aa req-bc019d5f-07a8-4510-b0da-a9e893eec9b3 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-5733738d-a11d-4656-ae5e-9cc193b572aa req-bc019d5f-07a8-4510-b0da-a9e893eec9b3 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:08:24 user nova-compute[74261]: WARNING nova.compute.manager [req-5733738d-a11d-4656-ae5e-9cc193b572aa req-bc019d5f-07a8-4510-b0da-a9e893eec9b3 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state building and task_state spawning.
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:08:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance spawned successfully.
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:08:24 user nova-compute[74261]: INFO nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 17 12:08:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:08:24 user nova-compute[74261]: INFO nova.compute.manager [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Took 24.84 seconds to build instance.
Oct 17 12:08:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-00ecfa31-dd59-4ee3-a77c-7b5478eb2dbd tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.976s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:08:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "82177488-87bb-4e64-9653-99f01b080ec0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:33 user nova-compute[74261]: INFO nova.compute.manager [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Terminating instance
Oct 17 12:08:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-fb411ea5-10f4-4538-aecb-39292b2e3920 req-a0cc2d31-5017-4e66-931c-2a25f46d7113 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fb411ea5-10f4-4538-aecb-39292b2e3920 req-a0cc2d31-5017-4e66-931c-2a25f46d7113 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fb411ea5-10f4-4538-aecb-39292b2e3920 req-a0cc2d31-5017-4e66-931c-2a25f46d7113 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fb411ea5-10f4-4538-aecb-39292b2e3920 req-a0cc2d31-5017-4e66-931c-2a25f46d7113 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-fb411ea5-10f4-4538-aecb-39292b2e3920 req-a0cc2d31-5017-4e66-931c-2a25f46d7113 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-fb411ea5-10f4-4538-aecb-39292b2e3920 req-a0cc2d31-5017-4e66-931c-2a25f46d7113 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-unplugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Instance destroyed successfully.
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'resources' on Instance uuid 82177488-87bb-4e64-9653-99f01b080ec0 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1958567919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1958567919',id=37,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:04:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-ggx4g40y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:06:47Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=82177488-87bb-4e64-9653-99f01b080ec0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "2f64c965-25b5-415a-9405-d51308c7243f", "address": "fa:16:3e:2d:0c:f7", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f64c965-25", "ovs_interfaceid": "2f64c965-25b5-415a-9405-d51308c7243f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_vif [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f64c965-25, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2047fc5-a00a-4106-a25b-36e760afae67) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:08:34 user nova-compute[74261]: INFO os_vif [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:0c:f7,bridge_name='br-int',has_traffic_filtering=True,id=2f64c965-25b5-415a-9405-d51308c7243f,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f64c965-25')
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRVkDOiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:08:34 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b931f42-ce86-4370-b053-05871e267d4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:08:34 user nova-compute[74261]: No targets found.
Oct 17 12:08:34 user nova-compute[74261]: iSNS:
Oct 17 12:08:34 user nova-compute[74261]: No targets found.
Oct 17 12:08:34 user nova-compute[74261]: STATIC:
Oct 17 12:08:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130
Oct 17 12:08:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4
Oct 17 12:08:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:08:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c
Oct 17 12:08:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:08:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:34 user nova-compute[74261]: FIRMWARE:
Oct 17 12:08:34 user nova-compute[74261]: No targets found.
Oct 17 12:08:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:08:34 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:08:34 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee7a57-0c22-45a0-b123-4b9a30acdb91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[915eba3d-794d-405b-9d79-8fbe474d7da4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)
Oct 17 12:08:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:34 user nova-compute[74261]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)
Oct 17 12:08:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b242bc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c'): ({'sde'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Removing single pathed devices sde {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e04016-0844-4682-86c5-7bf86ee0fe16]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5666fb1c-22ff-4826-905f-8e8c6df2bc95]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flushing IO for device /dev/sde {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2ea24-d878-440f-a0da-61c2e98d7cb3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3b8b71-aa06-4f33-8c07-7d6649716b51]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] SCSI volumes sde have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9e525850', '/dev/disk/by-id/scsi-1SCST_BIO9e525850-b2dfe19bcc6d4a29', '/dev/disk/by-id/scsi-26232646665313962') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d33fa0d-46b9-4651-a8ff-ab0b7870d500]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd3f47d-a1d6-4fff-9813-5977893f2df8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[796facc8-e467-49aa-9fc0-5532108471b7]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260]
Oct 17 12:08:34 user nova-compute[74261]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c, portal: 172.16.0.220,3260] successful.
Oct 17 12:08:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26bc3d98-c013-449a-af6d-4dee21acf15c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6af4d8-84ed-4b5e-8da8-2e10994ae350]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== disconnect_volume: return (390ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:08:34 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Deleting instance files /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0_del
Oct 17 12:08:34 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Deletion of /opt/stack/data/nova/instances/82177488-87bb-4e64-9653-99f01b080ec0_del complete
Oct 17 12:08:34 user nova-compute[74261]: INFO nova.compute.manager [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 17 12:08:34 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:08:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-8bbe5f1d-fce0-47f0-bce7-b6804d1356a4 req-1323fff1-5144-4fc3-8c41-9b5838094d53 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-deleted-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:08:35 user nova-compute[74261]: INFO nova.compute.manager [req-8bbe5f1d-fce0-47f0-bce7-b6804d1356a4 req-1323fff1-5144-4fc3-8c41-9b5838094d53 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Neutron deleted interface 2f64c965-25b5-415a-9405-d51308c7243f; detaching it from the instance and deleting it from the info cache
Oct 17 12:08:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-8bbe5f1d-fce0-47f0-bce7-b6804d1356a4 req-1323fff1-5144-4fc3-8c41-9b5838094d53 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:08:35 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Took 0.49 seconds to deallocate network for instance.
Oct 17 12:08:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-8bbe5f1d-fce0-47f0-bce7-b6804d1356a4 req-1323fff1-5144-4fc3-8c41-9b5838094d53 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Detach interface failed, port_id=2f64c965-25b5-415a-9405-d51308c7243f, reason: Instance 82177488-87bb-4e64-9653-99f01b080ec0 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ddd311f-580b-4730-8515-609907a2f698 req-9707c8cf-7949-45d3-8bc3-5dcc1dc0a728 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ddd311f-580b-4730-8515-609907a2f698 req-9707c8cf-7949-45d3-8bc3-5dcc1dc0a728 service nova] Acquiring lock "82177488-87bb-4e64-9653-99f01b080ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ddd311f-580b-4730-8515-609907a2f698 req-9707c8cf-7949-45d3-8bc3-5dcc1dc0a728 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4ddd311f-580b-4730-8515-609907a2f698 req-9707c8cf-7949-45d3-8bc3-5dcc1dc0a728 service nova] Lock "82177488-87bb-4e64-9653-99f01b080ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-4ddd311f-580b-4730-8515-609907a2f698 req-9707c8cf-7949-45d3-8bc3-5dcc1dc0a728 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] No waiting events found dispatching network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:08:35 user nova-compute[74261]: WARNING nova.compute.manager [req-4ddd311f-580b-4730-8515-609907a2f698 req-9707c8cf-7949-45d3-8bc3-5dcc1dc0a728 service nova] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Received unexpected event network-vif-plugged-2f64c965-25b5-415a-9405-d51308c7243f for instance with vm_state active and task_state deleting.
Oct 17 12:08:35 user nova-compute[74261]: INFO nova.compute.manager [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 82177488-87bb-4e64-9653-99f01b080ec0] Took 0.91 seconds to detach 1 volumes for instance.
Oct 17 12:08:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:08:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:08:36 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:08:36 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:08:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:36 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Deleted allocations for instance 82177488-87bb-4e64-9653-99f01b080ec0
Oct 17 12:08:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b264f6e1-6950-40d6-a0b1-f71fe0b37731 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "82177488-87bb-4e64-9653-99f01b080ec0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.306s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 is timed out.
Oct 17 12:08:43 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Successfully detached device vdc from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the live domain config.
Oct 17 12:08:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DILZlCFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:08:43 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[06086a85-2497-4c3b-bcdb-424d4b5beb50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:08:43 user nova-compute[74261]: No targets found.
Oct 17 12:08:43 user nova-compute[74261]: iSNS:
Oct 17 12:08:43 user nova-compute[74261]: No targets found.
Oct 17 12:08:43 user nova-compute[74261]: STATIC:
Oct 17 12:08:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130
Oct 17 12:08:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4
Oct 17 12:08:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:08:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:43 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:08:43 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:08:43 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:08:43 user nova-compute[74261]: FIRMWARE:
Oct 17 12:08:43 user nova-compute[74261]: No targets found.
Oct 17 12:08:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:08:43 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:08:43 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb5dccc-b2a6-492c-a6e1-ef35c5ed781b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd00da-3e4e-41a4-bfba-15161bb60f53]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:43 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:43 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:43 user nova-compute[74261]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)
Oct 17 12:08:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:08:43 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:08:43 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:08:43 user nova-compute[74261]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 (non-flash)
Oct 17 12:08:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24268b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130'): ({'sdf'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Removing single pathed devices sdf {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9e00f-4497-48f4-abf2-495187bd0576]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad0e5a-ff8b-4cb4-b923-288a0825ea09]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Flushing IO for device /dev/sdf {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dd00ff-b3e5-4fa3-9152-3216139d1ec1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5b2a43-dacf-41df-a4d1-51dba2fcb6b1]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] SCSI volumes sdf have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[17167238-5502-4938-a349-0b6c1faa30b8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9538e7-363c-4d3a-a066-6b163de5f06c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260]
Oct 17 12:08:44 user nova-compute[74261]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130, portal: 172.16.0.220,3260] successful.
Oct 17 12:08:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f585801-749e-4701-bb24-c4684c1b4130 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[725cbf1d-4bca-455f-a159-2789b1f1dd95]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] <== disconnect_volume: return (296ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'flavor' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:08:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b0dbacfe-637d-41c0-b02a-1766ed93d7c8 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:08:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:08:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:09:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:09:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:09:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:09 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:10 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:13 user nova-compute[74261]: INFO nova.compute.manager [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Detaching volume 2161ca84-95ec-4297-9865-3474f96a12d4
Oct 17 12:09:13 user nova-compute[74261]: INFO nova.virt.block_device [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Attempting to driver detach volume 2161ca84-95ec-4297-9865-3474f96a12d4 from mountpoint /dev/vdb
Oct 17 12:09:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Attempting to detach device vdb from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:09:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:09:13 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:09:13 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:09:13 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:09:13 user nova-compute[74261]:   <serial>2161ca84-95ec-4297-9865-3474f96a12d4</serial>
Oct 17 12:09:13 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:09:13 user nova-compute[74261]: </disk>
Oct 17 12:09:13 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:09:13 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Successfully detached device vdb from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the persistent domain config.
Oct 17 12:09:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:09:13 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:09:13 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:09:13 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:09:13 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:09:13 user nova-compute[74261]:   <serial>2161ca84-95ec-4297-9865-3474f96a12d4</serial>
Oct 17 12:09:13 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:09:13 user nova-compute[74261]: </disk>
Oct 17 12:09:13 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:16 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:09:16 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8461MB free_disk=25.022228240966797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance a4628ad3-6edb-4038-bba4-05421317e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 85b00045-b0be-4a06-9930-3d2950bde8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:09:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:20 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:09:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "a4628ad3-6edb-4038-bba4-05421317e568" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:24 user nova-compute[74261]: INFO nova.compute.manager [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Terminating instance
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-aafc5bd9-1b69-4a7b-82c9-7151d30797c8 req-635f1715-c398-4123-acf4-4eb0e8c438c4 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-vif-unplugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-aafc5bd9-1b69-4a7b-82c9-7151d30797c8 req-635f1715-c398-4123-acf4-4eb0e8c438c4 service nova] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-aafc5bd9-1b69-4a7b-82c9-7151d30797c8 req-635f1715-c398-4123-acf4-4eb0e8c438c4 service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-aafc5bd9-1b69-4a7b-82c9-7151d30797c8 req-635f1715-c398-4123-acf4-4eb0e8c438c4 service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-aafc5bd9-1b69-4a7b-82c9-7151d30797c8 req-635f1715-c398-4123-acf4-4eb0e8c438c4 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] No waiting events found dispatching network-vif-unplugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-aafc5bd9-1b69-4a7b-82c9-7151d30797c8 req-635f1715-c398-4123-acf4-4eb0e8c438c4 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-vif-unplugged-f0b58352-413e-402a-b849-314f2e2302e0 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Instance destroyed successfully.
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.objects.instance [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'resources' on Instance uuid a4628ad3-6edb-4038-bba4-05421317e568 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1981995023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1981995023',id=32,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:59:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-r56rpiso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:01:08Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=a4628ad3-6edb-4038-bba4-05421317e568,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "f0b58352-413e-402a-b849-314f2e2302e0", "address": "fa:16:3e:7d:e0:ee", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b58352-41", "ovs_interfaceid": "f0b58352-413e-402a-b849-314f2e2302e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG os_vif [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b58352-41, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96178207-d754-456c-af59-e0510f57203e) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:24 user nova-compute[74261]: INFO os_vif [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e0:ee,bridge_name='br-int',has_traffic_filtering=True,id=f0b58352-413e-402a-b849-314f2e2302e0,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b58352-41')
Oct 17 12:09:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Deleting instance files /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568_del
Oct 17 12:09:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Deletion of /opt/stack/data/nova/instances/a4628ad3-6edb-4038-bba4-05421317e568_del complete
Oct 17 12:09:24 user nova-compute[74261]: INFO nova.compute.manager [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 17 12:09:24 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:09:24 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: a4628ad3-6edb-4038-bba4-05421317e568] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:09:25 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:09:25 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Took 0.42 seconds to deallocate network for instance.
Oct 17 12:09:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:25 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:09:25 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:09:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:25 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Deleted allocations for instance a4628ad3-6edb-4038-bba4-05421317e568
Oct 17 12:09:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-908e9d69-090c-4c25-b8d3-2b80ea69277d tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "a4628ad3-6edb-4038-bba4-05421317e568" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.520s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] Acquiring lock "a4628ad3-6edb-4038-bba4-05421317e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] Lock "a4628ad3-6edb-4038-bba4-05421317e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] No waiting events found dispatching network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:09:26 user nova-compute[74261]: WARNING nova.compute.manager [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received unexpected event network-vif-plugged-f0b58352-413e-402a-b849-314f2e2302e0 for instance with vm_state deleted and task_state None.
Oct 17 12:09:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-939ca8d1-c93a-4eb5-a53c-194ddb4e498a req-a5441917-9b4c-4737-8420-f2da71e69d21 service nova] [instance: a4628ad3-6edb-4038-bba4-05421317e568] Received event network-vif-deleted-f0b58352-413e-402a-b849-314f2e2302e0 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:09:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:34 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 is timed out.
Oct 17 12:09:34 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Successfully detached device vdb from instance 7a1735a7-236f-4da4-b2a1-63c40d175b51 from the live domain config.
Oct 17 12:09:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzsatVYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:09:34 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6cdf28-7d98-4bed-909a-798d7ed1cced]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:09:34 user nova-compute[74261]: No targets found.
Oct 17 12:09:34 user nova-compute[74261]: iSNS:
Oct 17 12:09:34 user nova-compute[74261]: No targets found.
Oct 17 12:09:34 user nova-compute[74261]: STATIC:
Oct 17 12:09:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4
Oct 17 12:09:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:09:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:09:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:09:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:09:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:09:34 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:09:34 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:09:34 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:09:34 user nova-compute[74261]: FIRMWARE:
Oct 17 12:09:34 user nova-compute[74261]: No targets found.
Oct 17 12:09:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:09:34 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:09:34 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb71aa1c-7bdd-47c0-9ee2-aa363d56c670]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8424e2e8-ad12-40b4-9b13-7fd3f2ec2b3f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:09:34 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:09:34 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:09:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:09:34 user nova-compute[74261]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 (non-flash)
Oct 17 12:09:34 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:09:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae871dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132639e-d233-494c-94c6-ba52509d2841]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a71719-f5fc-44e1-95ed-4394ed613f79]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576306d-4823-444f-9262-dc0c79c7008f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1ecd23-e0f4-4d4f-9374-db44f1a4aa03]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[12112238-d8b6-4eb9-a1f9-cafb251527dd]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b32a74-ba44-4883-a4d5-9591982dc2bb]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260]
Oct 17 12:09:34 user nova-compute[74261]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4, portal: 172.16.0.220,3260] successful.
Oct 17 12:09:34 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2161ca84-95ec-4297-9865-3474f96a12d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a24fd51-42a4-450f-b3a4-f20962eca5f7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] <== disconnect_volume: return (308ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:09:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:35 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'flavor' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:09:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ca509800-0dcf-4e0d-b741-0908064e44e7 tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:09:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:09:41 user nova-compute[74261]: INFO nova.compute.claims [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Claim successful on node user
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:09:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.policy [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '539289bce741475693adef12bd561c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d347c39d44761af3558abf37f7822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:09:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Creating image(s)
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "/opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "/opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "/opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.228s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk 1073741824" returned: 0 in 0.059s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Successfully created port: 05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Cannot resize image /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Ensure instance console log exists: /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Successfully updated port: 05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquired lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-changed-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Refreshing instance network info cache due to event network-changed-05b924ff-b85c-4732-b0c4-12594e5c759c. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] Acquiring lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating instance_info_cache with network_info: [{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Releasing lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Instance network_info: |[{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] Acquired lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.neutron [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Refreshing network info cache for port 05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Start _get_guest_xml network_info=[{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:09:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:09:43 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1000672693',display_name='tempest-VolumesSnapshotTestJSON-instance-1000672693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1000672693',id=40,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdJscglWN9VvzySMNQX8eKMtvcKEij/DM8InOVwpALhMK9AakjLRKj1Uc8saHPBEoaglixFTGTV0jWzb89lKA4r0b8QF9oOq6RdmbGPjiOHMVnggKzzhzvjZhZfVIh/+Q==',key_name='tempest-keypair-2002492860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d347c39d44761af3558abf37f7822',ramdisk_id='',reservation_id='r-2yv40woz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072624135',owner_user_name='tempest-VolumesSnapshotTestJSON-1072624135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539289bce741475693adef12bd561c95',uuid=78fe14a5-64c3-486f-b3b8-9c087a4bbfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converting VIF {"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.objects.instance [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'pci_devices' on Instance uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:09:43 user nova-compute[74261]:   <uuid>78fe14a5-64c3-486f-b3b8-9c087a4bbfad</uuid>
Oct 17 12:09:43 user nova-compute[74261]:   <name>instance-00000028</name>
Oct 17 12:09:43 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:09:43 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:09:43 user nova-compute[74261]:   <metadata>
Oct 17 12:09:43 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:09:43 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:09:43 user nova-compute[74261]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1000672693</nova:name>
Oct 17 12:09:43 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:09:43</nova:creationTime>
Oct 17 12:09:43 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:09:43 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:09:43 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:09:43 user nova-compute[74261]:       <nova:owner>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:user uuid="539289bce741475693adef12bd561c95">tempest-VolumesSnapshotTestJSON-1072624135-project-member</nova:user>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:project uuid="457d347c39d44761af3558abf37f7822">tempest-VolumesSnapshotTestJSON-1072624135</nova:project>
Oct 17 12:09:43 user nova-compute[74261]:       </nova:owner>
Oct 17 12:09:43 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:09:43 user nova-compute[74261]:       <nova:ports>
Oct 17 12:09:43 user nova-compute[74261]:         <nova:port uuid="05b924ff-b85c-4732-b0c4-12594e5c759c">
Oct 17 12:09:43 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 12:09:43 user nova-compute[74261]:         </nova:port>
Oct 17 12:09:43 user nova-compute[74261]:       </nova:ports>
Oct 17 12:09:43 user nova-compute[74261]:     </nova:instance>
Oct 17 12:09:43 user nova-compute[74261]:   </metadata>
Oct 17 12:09:43 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:09:43 user nova-compute[74261]:     <system>
Oct 17 12:09:43 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:09:43 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:09:43 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:09:43 user nova-compute[74261]:       <entry name="serial">78fe14a5-64c3-486f-b3b8-9c087a4bbfad</entry>
Oct 17 12:09:43 user nova-compute[74261]:       <entry name="uuid">78fe14a5-64c3-486f-b3b8-9c087a4bbfad</entry>
Oct 17 12:09:43 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:09:43 user nova-compute[74261]:     </system>
Oct 17 12:09:43 user nova-compute[74261]:   </sysinfo>
Oct 17 12:09:43 user nova-compute[74261]:   <os>
Oct 17 12:09:43 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:09:43 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:09:43 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:09:43 user nova-compute[74261]:   </os>
Oct 17 12:09:43 user nova-compute[74261]:   <features>
Oct 17 12:09:43 user nova-compute[74261]:     <acpi/>
Oct 17 12:09:43 user nova-compute[74261]:     <apic/>
Oct 17 12:09:43 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:09:43 user nova-compute[74261]:   </features>
Oct 17 12:09:43 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:09:43 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:09:43 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:09:43 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:09:43 user nova-compute[74261]:   </clock>
Oct 17 12:09:43 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:09:43 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:09:43 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:09:43 user nova-compute[74261]:   </cpu>
Oct 17 12:09:43 user nova-compute[74261]:   <devices>
Oct 17 12:09:43 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:09:43 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:09:43 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk"/>
Oct 17 12:09:43 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:09:43 user nova-compute[74261]:     </disk>
Oct 17 12:09:43 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:09:43 user nova-compute[74261]:       <mac address="fa:16:3e:b1:d5:72"/>
Oct 17 12:09:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:09:43 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:09:43 user nova-compute[74261]:       <target dev="tap05b924ff-b8"/>
Oct 17 12:09:43 user nova-compute[74261]:     </interface>
Oct 17 12:09:43 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:09:43 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/console.log" append="off"/>
Oct 17 12:09:43 user nova-compute[74261]:     </serial>
Oct 17 12:09:43 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:09:43 user nova-compute[74261]:     <video>
Oct 17 12:09:43 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:09:43 user nova-compute[74261]:     </video>
Oct 17 12:09:43 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:09:43 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:09:43 user nova-compute[74261]:     </rng>
Oct 17 12:09:43 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:09:43 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:09:43 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:09:43 user nova-compute[74261]:     </memballoon>
Oct 17 12:09:43 user nova-compute[74261]:   </devices>
Oct 17 12:09:43 user nova-compute[74261]: </domain>
Oct 17 12:09:43 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1000672693',display_name='tempest-VolumesSnapshotTestJSON-instance-1000672693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1000672693',id=40,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdJscglWN9VvzySMNQX8eKMtvcKEij/DM8InOVwpALhMK9AakjLRKj1Uc8saHPBEoaglixFTGTV0jWzb89lKA4r0b8QF9oOq6RdmbGPjiOHMVnggKzzhzvjZhZfVIh/+Q==',key_name='tempest-keypair-2002492860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d347c39d44761af3558abf37f7822',ramdisk_id='',reservation_id='r-2yv40woz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072624135',owner_user_name='tempest-VolumesSnapshotTestJSON-1072624135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539289bce741475693adef12bd561c95',uuid=78fe14a5-64c3-486f-b3b8-9c087a4bbfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converting VIF {"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG os_vif [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d26de81-3efa-5318-9ee8-edcc5b4f1f99', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05b924ff-b8, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05b924ff-b8, col_values=(('qos', UUID('9120f0be-ff2c-44d1-9f38-947a1d8c9dd3')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05b924ff-b8, col_values=(('external_ids', {'iface-id': '05b924ff-b85c-4732-b0c4-12594e5c759c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:d5:72', 'vm-uuid': '78fe14a5-64c3-486f-b3b8-9c087a4bbfad'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:43 user nova-compute[74261]: INFO os_vif [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8')
Oct 17 12:09:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:09:44 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No VIF found with MAC fa:16:3e:b1:d5:72, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:09:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updated VIF entry in instance network info cache for port 05b924ff-b85c-4732-b0c4-12594e5c759c. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:09:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating instance_info_cache with network_info: [{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:09:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8c086213-3a47-4f1b-938d-a1e6f6d1d58d req-867f771c-dcc4-485d-b8a1-c5147d686dc5 service nova] Releasing lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-9eea9a19-795f-4039-97be-703bd7d4269d req-2d7a0573-6ea6-4181-8994-cd86aa536554 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9eea9a19-795f-4039-97be-703bd7d4269d req-2d7a0573-6ea6-4181-8994-cd86aa536554 service nova] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9eea9a19-795f-4039-97be-703bd7d4269d req-2d7a0573-6ea6-4181-8994-cd86aa536554 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9eea9a19-795f-4039-97be-703bd7d4269d req-2d7a0573-6ea6-4181-8994-cd86aa536554 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-9eea9a19-795f-4039-97be-703bd7d4269d req-2d7a0573-6ea6-4181-8994-cd86aa536554 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] No waiting events found dispatching network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:09:45 user nova-compute[74261]: WARNING nova.compute.manager [req-9eea9a19-795f-4039-97be-703bd7d4269d req-2d7a0573-6ea6-4181-8994-cd86aa536554 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received unexpected event network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c for instance with vm_state building and task_state spawning.
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:09:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Instance spawned successfully.
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-58e6c9b9-02e8-4c66-b5ea-5d7b84b26142 req-36605969-5f7f-438d-ba6b-5f22b3df52e7 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-58e6c9b9-02e8-4c66-b5ea-5d7b84b26142 req-36605969-5f7f-438d-ba6b-5f22b3df52e7 service nova] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-58e6c9b9-02e8-4c66-b5ea-5d7b84b26142 req-36605969-5f7f-438d-ba6b-5f22b3df52e7 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-58e6c9b9-02e8-4c66-b5ea-5d7b84b26142 req-36605969-5f7f-438d-ba6b-5f22b3df52e7 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-58e6c9b9-02e8-4c66-b5ea-5d7b84b26142 req-36605969-5f7f-438d-ba6b-5f22b3df52e7 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] No waiting events found dispatching network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:09:47 user nova-compute[74261]: WARNING nova.compute.manager [req-58e6c9b9-02e8-4c66-b5ea-5d7b84b26142 req-36605969-5f7f-438d-ba6b-5f22b3df52e7 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received unexpected event network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c for instance with vm_state building and task_state spawning.
Oct 17 12:09:47 user nova-compute[74261]: INFO nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Took 5.33 seconds to spawn the instance on the hypervisor.
Oct 17 12:09:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:09:47 user nova-compute[74261]: INFO nova.compute.manager [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Took 5.98 seconds to build instance.
Oct 17 12:09:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-0f0c5fe2-316c-4792-905f-0f78905e8b56 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.169s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing instance network info cache due to event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:09:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:09:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:09:52 user nova-compute[74261]: DEBUG nova.network.neutron [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG nova.network.neutron [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updated VIF entry in instance network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG nova.network.neutron [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-01605574-c4d3-4a89-98c5-2c04b050f067 req-1091962e-19d1-4c94-9755-be1530947802 service nova] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:53 user nova-compute[74261]: INFO nova.compute.manager [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Shelve offloading
Oct 17 12:09:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-66e2884d-d375-437d-9bf0-65198d4d8939 req-80c8569c-46f0-4ef3-aad8-aac02cbe41fd service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66e2884d-d375-437d-9bf0-65198d4d8939 req-80c8569c-46f0-4ef3-aad8-aac02cbe41fd service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66e2884d-d375-437d-9bf0-65198d4d8939 req-80c8569c-46f0-4ef3-aad8-aac02cbe41fd service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66e2884d-d375-437d-9bf0-65198d4d8939 req-80c8569c-46f0-4ef3-aad8-aac02cbe41fd service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-66e2884d-d375-437d-9bf0-65198d4d8939 req-80c8569c-46f0-4ef3-aad8-aac02cbe41fd service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:09:53 user nova-compute[74261]: WARNING nova.compute.manager [req-66e2884d-d375-437d-9bf0-65198d4d8939 req-80c8569c-46f0-4ef3-aad8-aac02cbe41fd service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state shelving.
Oct 17 12:09:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance destroyed successfully.
Oct 17 12:09:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:09:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:09:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance destroyed successfully.
Oct 17 12:09:54 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'resources' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1063978881',display_name='tempest-TestShelveInstance-server-1063978881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1063978881',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrTUUeK6d576D9Wi7TY+mmNKRECFGNY6cDZ0WkMgsYIe3SVO+Je/Ha74c5BJoREGP2jz3v3y8VEpS+xufvGin7NbE+IB0xqAI7jEH6pIbRjrVdH61ocBm5U2vD06IMmUw==',key_name='tempest-TestShelveInstance-1798180429',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b7d085514a94bc08f49773b28b92d86',ramdisk_id='',reservation_id='r-9co0384g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1038321046',owner_user_name='tempest-TestShelveInstance-1038321046-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:08:25Z,user_data=None,user_id='236acb378dd5414d9da0402b28550a4f',uuid=85b00045-b0be-4a06-9930-3d2950bde8a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converting VIF {"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_vif [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap793feba2-60, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=640e8b7a-8dab-430c-92b5-3b1093e5dc23) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:54 user nova-compute[74261]: INFO os_vif [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60')
Oct 17 12:09:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:09:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1205a98-ff3b-45ed-9a72-ebb103a6db41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:09:54 user nova-compute[74261]: No targets found.
Oct 17 12:09:54 user nova-compute[74261]: iSNS:
Oct 17 12:09:54 user nova-compute[74261]: No targets found.
Oct 17 12:09:54 user nova-compute[74261]: STATIC:
Oct 17 12:09:54 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:09:54 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:09:54 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:09:54 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:09:54 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:09:54 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:09:54 user nova-compute[74261]: FIRMWARE:
Oct 17 12:09:54 user nova-compute[74261]: No targets found.
Oct 17 12:09:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:09:54 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:09:54 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e91b75-c766-4714-882f-de480e9fd585]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135f3eb-6dd1-42e8-bbfc-a32aeacfcb86]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:09:55 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:09:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:09:55 user nova-compute[74261]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:09:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c65b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab'): ({'sdd'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Removing single pathed devices sdd {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ce121-9ba7-41bd-abf5-c7e8a322cf83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c517815-cf23-42c4-a6ca-6256e3b7514b]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Flushing IO for device /dev/sdd {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c4b0f4-71cf-4dcc-bd7b-6ea65121156b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db405e75-f8d2-4cb3-87ba-57a464168af2]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] SCSI volumes sdd have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[917fa0ea-60da-468b-be65-a5566fb9a954]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a30c99-a468-490c-8ba6-85c30d731d61]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]
Oct 17 12:09:55 user nova-compute[74261]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.
Oct 17 12:09:55 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a088b069-2268-4b7e-b391-ee5c892ca3d9]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] <== disconnect_volume: return (289ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:09:55 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Deleting instance files /opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6_del
Oct 17 12:09:55 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Deletion of /opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6_del complete
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:09:55 user nova-compute[74261]: WARNING nova.compute.manager [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state shelving.
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.compute.manager [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing instance network info cache due to event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updated VIF entry in instance network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:09:55 user nova-compute[74261]: DEBUG nova.network.neutron [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": null, "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap793feba2-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-97ff72d5-fef9-4333-a387-69c60758c99f req-c433a154-c765-4b74-843d-0fc81ebb0947 service nova] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:09:56 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Deleted allocations for instance 85b00045-b0be-4a06-9930-3d2950bde8a6
Oct 17 12:09:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG nova.objects.base [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Object Instance<85b00045-b0be-4a06-9930-3d2950bde8a6> lazy-loaded attributes: resources,numa_topology {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d6d6f1b8-1e2d-4d11-9b74-a8875d3eec95 tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.558s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:09:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:09:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:04 user nova-compute[74261]: INFO nova.compute.manager [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Terminating instance
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd76b7bf-f7d8-44bc-9b1e-f7ae9f99dab5 req-dadd37ad-b36f-430f-bae4-9345da4939bf service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-vif-unplugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd76b7bf-f7d8-44bc-9b1e-f7ae9f99dab5 req-dadd37ad-b36f-430f-bae4-9345da4939bf service nova] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd76b7bf-f7d8-44bc-9b1e-f7ae9f99dab5 req-dadd37ad-b36f-430f-bae4-9345da4939bf service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd76b7bf-f7d8-44bc-9b1e-f7ae9f99dab5 req-dadd37ad-b36f-430f-bae4-9345da4939bf service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd76b7bf-f7d8-44bc-9b1e-f7ae9f99dab5 req-dadd37ad-b36f-430f-bae4-9345da4939bf service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] No waiting events found dispatching network-vif-unplugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd76b7bf-f7d8-44bc-9b1e-f7ae9f99dab5 req-dadd37ad-b36f-430f-bae4-9345da4939bf service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-vif-unplugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Instance destroyed successfully.
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.objects.instance [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lazy-loading 'resources' on Instance uuid 7a1735a7-236f-4da4-b2a1-63c40d175b51 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1297016953',display_name='tempest-TestServerVolumeAttachmentScenario-server-1297016953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1297016953',id=38,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOz3/9jGVPl2TgmSu0XSPRh6ppvIxZeoNwdkL2uxhUvAOIVw0fgkVZPdfsY+Hk775cblwkgrgAv31k7aik5jVP4b+Br20Xg2L4VlVF/+Ructz95q/7W9Go0WGbXG1x2cGQ==',key_name='tempest-keypair-1519646987',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06657771107947418c199d9955a9c2f5',ramdisk_id='',reservation_id='r-y3ivjndf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-96207815',owner_user_name='tempest-TestServerVolumeAttachmentScenario-96207815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b58f7d968afe43dba578c46afe76a2cc',uuid=7a1735a7-236f-4da4-b2a1-63c40d175b51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Converting VIF {"id": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "address": "fa:16:3e:2c:c2:b6", "network": {"id": "1d580c72-0415-4f2e-8ea2-1143bab4dd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485405060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06657771107947418c199d9955a9c2f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4837a8f-57", "ovs_interfaceid": "f4837a8f-5700-4e4f-8b8f-371d09689fb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG os_vif [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4837a8f-57, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30909e46-bb3f-4f98-99c2-f6500dcb51f0) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:10:04 user nova-compute[74261]: INFO os_vif [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:c2:b6,bridge_name='br-int',has_traffic_filtering=True,id=f4837a8f-5700-4e4f-8b8f-371d09689fb1,network=Network(1d580c72-0415-4f2e-8ea2-1143bab4dd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4837a8f-57')
Oct 17 12:10:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Deleting instance files /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51_del
Oct 17 12:10:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Deletion of /opt/stack/data/nova/instances/7a1735a7-236f-4da4-b2a1-63c40d175b51_del complete
Oct 17 12:10:04 user nova-compute[74261]: INFO nova.compute.manager [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 17 12:10:04 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:10:04 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:10:05 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:10:05 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Took 0.83 seconds to deallocate network for instance.
Oct 17 12:10:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-4fb4c5a6-6c3f-4189-8b8b-44c2b1a7a146 req-5eec3bfc-d49f-4f73-bdb5-5064d6359028 service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-vif-deleted-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:10:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:06 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Deleted allocations for instance 7a1735a7-236f-4da4-b2a1-63c40d175b51
Oct 17 12:10:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-43bdc5db-4f60-4b12-aed2-0ac601150e9c tempest-TestServerVolumeAttachmentScenario-96207815 tempest-TestServerVolumeAttachmentScenario-96207815-project-member] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a93957a-9869-49cf-932e-d800b4b69b0e req-fb32c63c-5b8e-4d7e-ab59-022a253a9d1a service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received event network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a93957a-9869-49cf-932e-d800b4b69b0e req-fb32c63c-5b8e-4d7e-ab59-022a253a9d1a service nova] Acquiring lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a93957a-9869-49cf-932e-d800b4b69b0e req-fb32c63c-5b8e-4d7e-ab59-022a253a9d1a service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a93957a-9869-49cf-932e-d800b4b69b0e req-fb32c63c-5b8e-4d7e-ab59-022a253a9d1a service nova] Lock "7a1735a7-236f-4da4-b2a1-63c40d175b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a93957a-9869-49cf-932e-d800b4b69b0e req-fb32c63c-5b8e-4d7e-ab59-022a253a9d1a service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] No waiting events found dispatching network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:10:06 user nova-compute[74261]: WARNING nova.compute.manager [req-8a93957a-9869-49cf-932e-d800b4b69b0e req-fb32c63c-5b8e-4d7e-ab59-022a253a9d1a service nova] [instance: 7a1735a7-236f-4da4-b2a1-63c40d175b51] Received unexpected event network-vif-plugged-f4837a8f-5700-4e4f-8b8f-371d09689fb1 for instance with vm_state deleted and task_state None.
Oct 17 12:10:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:12 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "7d774988-6ac5-4701-a34e-64b99df1687e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:14 user nova-compute[74261]: INFO nova.compute.manager [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Terminating instance
Oct 17 12:10:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG nova.compute.manager [req-b5ee639b-ac74-41d2-832e-5b89eebfabb3 req-de3b401c-db8c-49ba-b544-a31a1bd67c45 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b5ee639b-ac74-41d2-832e-5b89eebfabb3 req-de3b401c-db8c-49ba-b544-a31a1bd67c45 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b5ee639b-ac74-41d2-832e-5b89eebfabb3 req-de3b401c-db8c-49ba-b544-a31a1bd67c45 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b5ee639b-ac74-41d2-832e-5b89eebfabb3 req-de3b401c-db8c-49ba-b544-a31a1bd67c45 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-b5ee639b-ac74-41d2-832e-5b89eebfabb3 req-de3b401c-db8c-49ba-b544-a31a1bd67c45 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-b5ee639b-ac74-41d2-832e-5b89eebfabb3 req-de3b401c-db8c-49ba-b544-a31a1bd67c45 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-unplugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Instance destroyed successfully.
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'resources' on Instance uuid 7d774988-6ac5-4701-a34e-64b99df1687e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191587520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191587520',id=25,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-jqhchyl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:57:23Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=7d774988-6ac5-4701-a34e-64b99df1687e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "a00ccd63-87f9-450f-acc7-397289e3a14b", "address": "fa:16:3e:cf:33:a5", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ccd63-87", "ovs_interfaceid": "a00ccd63-87f9-450f-acc7-397289e3a14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_vif [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa00ccd63-87, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8eb9a00-9b5a-4f6c-8d36-16756819ad7c) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:10:15 user nova-compute[74261]: INFO os_vif [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=a00ccd63-87f9-450f-acc7-397289e3a14b,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ccd63-87')
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJoPViuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:10:15 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e78e83-ac3b-477b-8081-bca4b24034d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:10:15 user nova-compute[74261]: No targets found.
Oct 17 12:10:15 user nova-compute[74261]: iSNS:
Oct 17 12:10:15 user nova-compute[74261]: No targets found.
Oct 17 12:10:15 user nova-compute[74261]: STATIC:
Oct 17 12:10:15 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7
Oct 17 12:10:15 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:10:15 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:10:15 user nova-compute[74261]: FIRMWARE:
Oct 17 12:10:15 user nova-compute[74261]: No targets found.
Oct 17 12:10:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:10:15 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:10:15 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba28b97-9090-44ba-8839-7d22962467b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca31b2-3123-4632-be09-214cb046e547]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:10:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 (non-flash)
Oct 17 12:10:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae871f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f93ad26-7a09-461b-b3f4-4d35941142da]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5444165-9582-41b3-8031-30c9e19c890b]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e99314-96f7-42fc-9947-3e0c52f4ebb3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f34989-59fb-4e92-a442-d006e14b55f0]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ddd52b-0e89-44ca-8603-72f6f1583516]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163059c-8c3b-47d5-8d39-cbf7721ab6f9]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260]
Oct 17 12:10:15 user nova-compute[74261]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7, portal: 172.16.0.220,3260] successful.
Oct 17 12:10:15 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92bb129-8243-435a-948e-6b01c4840ac7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[df268726-ce96-4ab5-acb4-46317a5e6d62]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] <== disconnect_volume: return (279ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:10:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Deleting instance files /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e_del
Oct 17 12:10:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Deletion of /opt/stack/data/nova/instances/7d774988-6ac5-4701-a34e-64b99df1687e_del complete
Oct 17 12:10:15 user nova-compute[74261]: INFO nova.compute.manager [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 17 12:10:15 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:10:15 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-61a889fd-7ae7-408d-90af-0de7cc65efe7 req-d4558247-505a-4c9a-bc07-2a4765863f08 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-deleted-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:10:16 user nova-compute[74261]: INFO nova.compute.manager [req-61a889fd-7ae7-408d-90af-0de7cc65efe7 req-d4558247-505a-4c9a-bc07-2a4765863f08 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Neutron deleted interface a00ccd63-87f9-450f-acc7-397289e3a14b; detaching it from the instance and deleting it from the info cache
Oct 17 12:10:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-61a889fd-7ae7-408d-90af-0de7cc65efe7 req-d4558247-505a-4c9a-bc07-2a4765863f08 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:10:16 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Took 0.88 seconds to deallocate network for instance.
Oct 17 12:10:16 user nova-compute[74261]: DEBUG nova.compute.manager [req-61a889fd-7ae7-408d-90af-0de7cc65efe7 req-d4558247-505a-4c9a-bc07-2a4765863f08 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Detach interface failed, port_id=a00ccd63-87f9-450f-acc7-397289e3a14b, reason: Instance 7d774988-6ac5-4701-a34e-64b99df1687e could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-eaccfff5-11c3-4595-a12a-e67d0c1738be req-77e488b4-974f-4c94-8747-12064a6d6a85 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eaccfff5-11c3-4595-a12a-e67d0c1738be req-77e488b4-974f-4c94-8747-12064a6d6a85 service nova] Acquiring lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eaccfff5-11c3-4595-a12a-e67d0c1738be req-77e488b4-974f-4c94-8747-12064a6d6a85 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-eaccfff5-11c3-4595-a12a-e67d0c1738be req-77e488b4-974f-4c94-8747-12064a6d6a85 service nova] Lock "7d774988-6ac5-4701-a34e-64b99df1687e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-eaccfff5-11c3-4595-a12a-e67d0c1738be req-77e488b4-974f-4c94-8747-12064a6d6a85 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] No waiting events found dispatching network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:10:17 user nova-compute[74261]: WARNING nova.compute.manager [req-eaccfff5-11c3-4595-a12a-e67d0c1738be req-77e488b4-974f-4c94-8747-12064a6d6a85 service nova] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Received unexpected event network-vif-plugged-a00ccd63-87f9-450f-acc7-397289e3a14b for instance with vm_state active and task_state deleting.
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:10:17 user nova-compute[74261]: INFO nova.compute.manager [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 7d774988-6ac5-4701-a34e-64b99df1687e] Took 0.82 seconds to detach 1 volumes for instance.
Oct 17 12:10:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:10:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.136249542236328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7d774988-6ac5-4701-a34e-64b99df1687e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:10:17 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:10:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:10:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.207s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:10:18 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:10:18 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:10:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:18 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Deleted allocations for instance 7d774988-6ac5-4701-a34e-64b99df1687e
Oct 17 12:10:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-da562081-5f8d-4ffa-9c5b-f92827e0374b tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "7d774988-6ac5-4701-a34e-64b99df1687e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.677s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:10:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:10:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:10:23 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [{"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:10:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:10:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:31 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:10:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:10:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:10:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:05 user nova-compute[74261]: INFO nova.compute.manager [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Terminating instance
Oct 17 12:11:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Instance destroyed successfully.
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.objects.instance [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lazy-loading 'resources' on Instance uuid 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T11:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1031484196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1031484196',id=20,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T11:50:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='022b95f3129c4493b0a69149e5b8dd4e',ramdisk_id='',reservation_id='r-h8x50o05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T11:52:34Z,user_data=None,user_id='19d191be36a54216a9e2d6a64660e582',uuid=1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converting VIF {"id": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "address": "fa:16:3e:9e:10:23", "network": {"id": "228f84fd-abb1-463a-9796-b92f7169b3e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-846112261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "022b95f3129c4493b0a69149e5b8dd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaa7969-50", "ovs_interfaceid": "cfaa7969-500a-4718-a2f2-d0c6498d9844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG os_vif [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfaa7969-50, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2173027-6d14-400c-8161-bf922cac4223) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: INFO os_vif [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:10:23,bridge_name='br-int',has_traffic_filtering=True,id=cfaa7969-500a-4718-a2f2-d0c6498d9844,network=Network(228f84fd-abb1-463a-9796-b92f7169b3e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaa7969-50')
Oct 17 12:11:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Deleting instance files /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3_del
Oct 17 12:11:06 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Deletion of /opt/stack/data/nova/instances/1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3_del complete
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-da77bb9f-6f0e-47d9-b846-6fb43b0a6c2e req-76351b3e-0ac7-4dc5-b117-1ee4e166e733 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-vif-unplugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-da77bb9f-6f0e-47d9-b846-6fb43b0a6c2e req-76351b3e-0ac7-4dc5-b117-1ee4e166e733 service nova] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-da77bb9f-6f0e-47d9-b846-6fb43b0a6c2e req-76351b3e-0ac7-4dc5-b117-1ee4e166e733 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-da77bb9f-6f0e-47d9-b846-6fb43b0a6c2e req-76351b3e-0ac7-4dc5-b117-1ee4e166e733 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-da77bb9f-6f0e-47d9-b846-6fb43b0a6c2e req-76351b3e-0ac7-4dc5-b117-1ee4e166e733 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] No waiting events found dispatching network-vif-unplugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-da77bb9f-6f0e-47d9-b846-6fb43b0a6c2e req-76351b3e-0ac7-4dc5-b117-1ee4e166e733 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-vif-unplugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:11:06 user nova-compute[74261]: INFO nova.compute.manager [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Took 0.77 seconds to destroy the instance on the hypervisor.
Oct 17 12:11:06 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:11:07 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Took 0.83 seconds to deallocate network for instance.
Oct 17 12:11:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.compute.manager [req-76b6ee82-d6c3-477d-b188-f4141764c37a req-225d5356-3c23-4fd6-9643-6e87214c5264 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-vif-deleted-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:11:07 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.710s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:07 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Deleted allocations for instance 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3
Oct 17 12:11:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-32112f4e-a61b-4f9f-8350-eeac07a86f08 tempest-ServerBootFromVolumeStableRescueTest-1400453141 tempest-ServerBootFromVolumeStableRescueTest-1400453141-project-member] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-042a798c-fb34-4b39-841c-762967afc3eb req-de6536f9-cec7-47fc-8c5c-4ca969a68876 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received event network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-042a798c-fb34-4b39-841c-762967afc3eb req-de6536f9-cec7-47fc-8c5c-4ca969a68876 service nova] Acquiring lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-042a798c-fb34-4b39-841c-762967afc3eb req-de6536f9-cec7-47fc-8c5c-4ca969a68876 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-042a798c-fb34-4b39-841c-762967afc3eb req-de6536f9-cec7-47fc-8c5c-4ca969a68876 service nova] Lock "1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-042a798c-fb34-4b39-841c-762967afc3eb req-de6536f9-cec7-47fc-8c5c-4ca969a68876 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] No waiting events found dispatching network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:11:08 user nova-compute[74261]: WARNING nova.compute.manager [req-042a798c-fb34-4b39-841c-762967afc3eb req-de6536f9-cec7-47fc-8c5c-4ca969a68876 service nova] [instance: 1c5bc28d-08f9-4f7e-88e1-81c4eea2e1f3] Received unexpected event network-vif-plugged-cfaa7969-500a-4718-a2f2-d0c6498d9844 for instance with vm_state deleted and task_state None.
Oct 17 12:11:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:16 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:11:17 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.258495330810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:11:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:11:18 user nova-compute[74261]: INFO nova.compute.claims [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Claim successful on node user
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.network.neutron [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:11:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.policy [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '405c17e59c6b4269aa9c6614e528e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9069e5b23c49358fdc9c631ad029c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:11:18 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Creating image(s)
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "/opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "/opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "/opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.230s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.186s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk 1073741824" returned: 0 in 0.059s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Cannot resize image /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Ensure instance console log exists: /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:19 user nova-compute[74261]: DEBUG nova.network.neutron [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Successfully created port: 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Successfully updated port: 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-changed-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Refreshing instance network info cache due to event network-changed-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Instance network_info: |[{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Refreshing network info cache for port 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Start _get_guest_xml network_info=[{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:11:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:11:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1490488529',display_name='tempest-SnapshotDataIntegrityTests-server-1490488529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1490488529',id=41,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9/EsZL8DY424CE/TlMnwMql/aB1kVG2pm+DHuoZsNj8N3gMqL1flc4mojK40a6pGgx7r9rsw5ffJhTOArmaiNZqjAsStEBq4czg+uQbXbc+TnjyRXhz+ZVhFQ/rtEEfg==',key_name='tempest-keypair-1921630278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e9069e5b23c49358fdc9c631ad029c4',ramdisk_id='',reservation_id='r-03f4kt6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-217820142',owner_user_name='tempest-SnapshotDataIntegrityTests-217820142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='405c17e59c6b4269aa9c6614e528e3b0',uuid=80f5ad0c-0558-477a-8319-87f995e4e065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Converting VIF {"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.objects.instance [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'pci_devices' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:11:21 user nova-compute[74261]:   <uuid>80f5ad0c-0558-477a-8319-87f995e4e065</uuid>
Oct 17 12:11:21 user nova-compute[74261]:   <name>instance-00000029</name>
Oct 17 12:11:21 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:11:21 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:11:21 user nova-compute[74261]:   <metadata>
Oct 17 12:11:21 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:11:21 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:11:21 user nova-compute[74261]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1490488529</nova:name>
Oct 17 12:11:21 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:11:21</nova:creationTime>
Oct 17 12:11:21 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:11:21 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:11:21 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:11:21 user nova-compute[74261]:       <nova:owner>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:user uuid="405c17e59c6b4269aa9c6614e528e3b0">tempest-SnapshotDataIntegrityTests-217820142-project-member</nova:user>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:project uuid="9e9069e5b23c49358fdc9c631ad029c4">tempest-SnapshotDataIntegrityTests-217820142</nova:project>
Oct 17 12:11:21 user nova-compute[74261]:       </nova:owner>
Oct 17 12:11:21 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:11:21 user nova-compute[74261]:       <nova:ports>
Oct 17 12:11:21 user nova-compute[74261]:         <nova:port uuid="6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc">
Oct 17 12:11:21 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 12:11:21 user nova-compute[74261]:         </nova:port>
Oct 17 12:11:21 user nova-compute[74261]:       </nova:ports>
Oct 17 12:11:21 user nova-compute[74261]:     </nova:instance>
Oct 17 12:11:21 user nova-compute[74261]:   </metadata>
Oct 17 12:11:21 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:11:21 user nova-compute[74261]:     <system>
Oct 17 12:11:21 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:11:21 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:11:21 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:11:21 user nova-compute[74261]:       <entry name="serial">80f5ad0c-0558-477a-8319-87f995e4e065</entry>
Oct 17 12:11:21 user nova-compute[74261]:       <entry name="uuid">80f5ad0c-0558-477a-8319-87f995e4e065</entry>
Oct 17 12:11:21 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:11:21 user nova-compute[74261]:     </system>
Oct 17 12:11:21 user nova-compute[74261]:   </sysinfo>
Oct 17 12:11:21 user nova-compute[74261]:   <os>
Oct 17 12:11:21 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:11:21 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:11:21 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:11:21 user nova-compute[74261]:   </os>
Oct 17 12:11:21 user nova-compute[74261]:   <features>
Oct 17 12:11:21 user nova-compute[74261]:     <acpi/>
Oct 17 12:11:21 user nova-compute[74261]:     <apic/>
Oct 17 12:11:21 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:11:21 user nova-compute[74261]:   </features>
Oct 17 12:11:21 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:11:21 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:11:21 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:11:21 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:11:21 user nova-compute[74261]:   </clock>
Oct 17 12:11:21 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:11:21 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:11:21 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:11:21 user nova-compute[74261]:   </cpu>
Oct 17 12:11:21 user nova-compute[74261]:   <devices>
Oct 17 12:11:21 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:11:21 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:11:21 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk"/>
Oct 17 12:11:21 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:11:21 user nova-compute[74261]:     </disk>
Oct 17 12:11:21 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:11:21 user nova-compute[74261]:       <mac address="fa:16:3e:31:38:cf"/>
Oct 17 12:11:21 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:11:21 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:11:21 user nova-compute[74261]:       <target dev="tap6ec6c362-b6"/>
Oct 17 12:11:21 user nova-compute[74261]:     </interface>
Oct 17 12:11:21 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:11:21 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/console.log" append="off"/>
Oct 17 12:11:21 user nova-compute[74261]:     </serial>
Oct 17 12:11:21 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:11:21 user nova-compute[74261]:     <video>
Oct 17 12:11:21 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:11:21 user nova-compute[74261]:     </video>
Oct 17 12:11:21 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:11:21 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:11:21 user nova-compute[74261]:     </rng>
Oct 17 12:11:21 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:11:21 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:11:21 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:11:21 user nova-compute[74261]:     </memballoon>
Oct 17 12:11:21 user nova-compute[74261]:   </devices>
Oct 17 12:11:21 user nova-compute[74261]: </domain>
Oct 17 12:11:21 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1490488529',display_name='tempest-SnapshotDataIntegrityTests-server-1490488529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1490488529',id=41,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9/EsZL8DY424CE/TlMnwMql/aB1kVG2pm+DHuoZsNj8N3gMqL1flc4mojK40a6pGgx7r9rsw5ffJhTOArmaiNZqjAsStEBq4czg+uQbXbc+TnjyRXhz+ZVhFQ/rtEEfg==',key_name='tempest-keypair-1921630278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e9069e5b23c49358fdc9c631ad029c4',ramdisk_id='',reservation_id='r-03f4kt6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-217820142',owner_user_name='tempest-SnapshotDataIntegrityTests-217820142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='405c17e59c6b4269aa9c6614e528e3b0',uuid=80f5ad0c-0558-477a-8319-87f995e4e065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Converting VIF {"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG os_vif [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2348ee3c-ec77-58b8-8e59-2718f69b58c5', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ec6c362-b6, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ec6c362-b6, col_values=(('qos', UUID('05402aae-a5d0-4c46-9290-0d8ad26cdba0')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ec6c362-b6, col_values=(('external_ids', {'iface-id': '6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:38:cf', 'vm-uuid': '80f5ad0c-0558-477a-8319-87f995e4e065'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: INFO os_vif [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6')
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No VIF found with MAC fa:16:3e:31:38:cf, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated VIF entry in instance network info cache for port 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG nova.network.neutron [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:11:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7e6d879-dd3c-4608-90cf-72e8616cdc28 req-997f03aa-91ba-4deb-8ebe-d1095dd2f7be service nova] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:11:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:22 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:11:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-ffb66705-77df-42b5-92b4-b68135aadfa5 req-a61e14f4-c532-402e-aca0-f9f2e65aac8f service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ffb66705-77df-42b5-92b4-b68135aadfa5 req-a61e14f4-c532-402e-aca0-f9f2e65aac8f service nova] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ffb66705-77df-42b5-92b4-b68135aadfa5 req-a61e14f4-c532-402e-aca0-f9f2e65aac8f service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ffb66705-77df-42b5-92b4-b68135aadfa5 req-a61e14f4-c532-402e-aca0-f9f2e65aac8f service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG nova.compute.manager [req-ffb66705-77df-42b5-92b4-b68135aadfa5 req-a61e14f4-c532-402e-aca0-f9f2e65aac8f service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] No waiting events found dispatching network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:11:23 user nova-compute[74261]: WARNING nova.compute.manager [req-ffb66705-77df-42b5-92b4-b68135aadfa5 req-a61e14f4-c532-402e-aca0-f9f2e65aac8f service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received unexpected event network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc for instance with vm_state building and task_state spawning.
Oct 17 12:11:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:11:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Instance spawned successfully.
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:11:24 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:11:25 user nova-compute[74261]: INFO nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 17 12:11:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:11:25 user nova-compute[74261]: INFO nova.compute.manager [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Took 6.67 seconds to build instance.
Oct 17 12:11:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-84f8461b-c856-43bf-ba6f-1bc95f677066 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.770s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-769a0c54-2082-49ce-8a8c-a73ed4c3ffe0 req-365d3861-d32e-4b09-8d00-c2daebd76dc8 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-769a0c54-2082-49ce-8a8c-a73ed4c3ffe0 req-365d3861-d32e-4b09-8d00-c2daebd76dc8 service nova] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-769a0c54-2082-49ce-8a8c-a73ed4c3ffe0 req-365d3861-d32e-4b09-8d00-c2daebd76dc8 service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-769a0c54-2082-49ce-8a8c-a73ed4c3ffe0 req-365d3861-d32e-4b09-8d00-c2daebd76dc8 service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-769a0c54-2082-49ce-8a8c-a73ed4c3ffe0 req-365d3861-d32e-4b09-8d00-c2daebd76dc8 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] No waiting events found dispatching network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:11:25 user nova-compute[74261]: WARNING nova.compute.manager [req-769a0c54-2082-49ce-8a8c-a73ed4c3ffe0 req-365d3861-d32e-4b09-8d00-c2daebd76dc8 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received unexpected event network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc for instance with vm_state active and task_state None.
Oct 17 12:11:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating instance_info_cache with network_info: [{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:11:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:11:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-changed-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Refreshing instance network info cache due to event network-changed-05b924ff-b85c-4732-b0c4-12594e5c759c. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] Acquiring lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] Acquired lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG nova.network.neutron [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Refreshing network info cache for port 05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG nova.objects.instance [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'flavor' on Instance uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:11:32 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Ignoring supplied device name: /dev/vdb
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:32 user nova-compute[74261]: INFO nova.compute.manager [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Attaching volume 67eda876-8239-4cf5-b372-1fc4364b859b to /dev/vdb
Oct 17 12:11:33 user nova-compute[74261]: DEBUG nova.network.neutron [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updated VIF entry in instance network info cache for port 05b924ff-b85c-4732-b0c4-12594e5c759c. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG nova.network.neutron [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating instance_info_cache with network_info: [{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6b2e6d9b-8b65-42a2-aff0-7997658f01c5 req-6eec09ea-2dd6-43e4-8358-d9b52f8bbfe1 service nova] Releasing lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG os_brick.utils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d24e66-012d-4b72-b68d-a88f6ec30e5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb28915-16ae-47b6-8e1a-fcb4d9af9510]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed6d42-ff64-4f0c-8b06-b777694fcf41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5181f9eb-9678-4296-bfac-6ef9feca6017]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:11:33 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:11:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4412a-a62d-4693-9095-f10875eefe6f]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG os_brick.utils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:11:33 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating existing volume attachment record: 0d282ee6-7b87-41ee-a1e2-ff2d4f4249c3 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:11:44 user nova-compute[74261]: INFO nova.compute.manager [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Unshelving
Oct 17 12:11:44 user nova-compute[74261]: INFO nova.virt.block_device [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Booting with volume 6dd8ffe3-9b66-4d52-b390-b364d8fc2fab at /dev/vda
Oct 17 12:11:44 user nova-compute[74261]: DEBUG os_brick.utils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba62a4-7f68-42d8-aa0a-de603b64f52e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1acef9-b11e-4e0d-8059-c2ee1b4b6f0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[25237468-e7e5-4db1-b94c-b4b04a9b5f1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d53ca-caea-42b6-a551-6b62b7f2f845]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:11:44 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:11:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87cb3b6-2c6c-46a2-ba5f-6190f1a95a83]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG os_brick.utils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:11:44 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating existing volume attachment record: de4580fa-7181-4400-bcb2-0167f1a9b69c {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:11:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:11:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYxeNFnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:12:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:12:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:12:04 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebfaf11-1568-422b-9159-5d47d25d4ee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:12:04 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12a8934-9371-430a-a78c-aeb5c88e7b43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b] added
Oct 17 12:12:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0344a690-9242-4d2d-8762-72c6be0e4298]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ee99f-2d4f-4563-87bd-e3c4690adda3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYxeNFnm {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYxeNFnm" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b4d05-c972-40c4-987e-63d485aadebc]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYxeNFnm'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c778c6b-8f4c-4b47-b032-1319ac7812d3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[907f2ad7-fbe6-406c-a2a9-56bdc0b67af1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:12:04 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:12:04 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:12:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:12:04 user nova-compute[74261]: 
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a951bc-e80b-43ac-a9b1-7e8907c4cafe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260]
Oct 17 12:12:04 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260] successful.
Oct 17 12:12:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'pci_requests' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d335740-67a9-48d7-a1a4-ea2e6e1fda77]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:12:04 user nova-compute[74261]: INFO nova.compute.claims [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Claim successful on node user
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[22958f19-a091-4448-b40b-ed20ca3c144d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:12:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:12:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2986eaa6-fc78-4ef9-a7c1-3bd53d9cf845]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:12:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:04 user nova-compute[74261]: INFO nova.network.neutron [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating port 793feba2-6044-4088-ada0-82adb93b9d3f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing instance network info cache due to event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYxeNFnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26338346563623033', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338346563623033', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.objects.instance [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'flavor' on Instance uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:12:05 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:12:05 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:12:05 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:12:05 user nova-compute[74261]:   <serial>67eda876-8239-4cf5-b372-1fc4364b859b</serial>
Oct 17 12:12:05 user nova-compute[74261]: </disk>
Oct 17 12:12:05 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.network.neutron [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:12:05 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Creating image(s)
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Ensure instance console log exists: /opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Start _get_guest_xml network_info=[{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'de4580fa-7181-4400-bcb2-0167f1a9b69c', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85b00045-b0be-4a06-9930-3d2950bde8a6', 'attached_at': '', 'detached_at': '', 'volume_id': '6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'serial': '6dd8ffe3-9b66-4d52-b390-b364d8fc2fab'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:12:05 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:12:05 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.objects.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Object Instance<85b00045-b0be-4a06-9930-3d2950bde8a6> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:12:05 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:12:05 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:12:05 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0e4a5f-7d5c-485d-b952-d5eb2e0a8c3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:12:05 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[20428356-47be-4f17-8adf-7fce5be0e1f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab] added
Oct 17 12:12:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No VIF found with MAC fa:16:3e:b1:d5:72, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c864e-97d5-45c0-bda0-ed1d96d5b708]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35073e6-37de-4a9e-b442-b9615e8617f8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQKpnwEb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQKpnwEb" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd9c34-295f-47e5-a2b9-8761136fb83f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQKpnwEb'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a67b86-171f-4111-9a92-d91093271bc1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94b859e-3a85-484a-9541-63ff68468e90]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:12:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:12:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-4605564f-9b0e-42d2-857d-effcf450c720 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.868s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1987e814-5373-4deb-90ff-66bb1b291ab5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]
Oct 17 12:12:05 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.
Oct 17 12:12:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f598de-38d8-4985-a03c-2af6b4fac57f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c7271-e6f1-4300-a44c-47bd7710aa9a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:12:05 user nova-compute[74261]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:12:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:12:05 user nova-compute[74261]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:12:05 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8547f09-373d-44ed-9222-778e320b0e75]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:12:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updated VIF entry in instance network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2a5d3809-4729-4684-855b-e5a2576c1f50 req-75ee1ef6-2f21-46dc-a788-3e95ea9dfe7c service nova] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23433653238343863', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:12:06 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433653238343863', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T12:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1063978881',display_name='tempest-TestShelveInstance-server-1063978881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1063978881',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1798180429',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b7d085514a94bc08f49773b28b92d86',ramdisk_id='',reservation_id='r-9co0384g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1038321046',owner_user_name='tempest-TestShelveInstance-1038321046-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:11:45Z,user_data=None,user_id='236acb378dd5414d9da0402b28550a4f',uuid=85b00045-b0be-4a06-9930-3d2950bde8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converting VIF {"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.objects.instance [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.objects.base [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Object Instance<85b00045-b0be-4a06-9930-3d2950bde8a6> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74261) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:12:07 user nova-compute[74261]:   <uuid>85b00045-b0be-4a06-9930-3d2950bde8a6</uuid>
Oct 17 12:12:07 user nova-compute[74261]:   <name>instance-00000027</name>
Oct 17 12:12:07 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:12:07 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:12:07 user nova-compute[74261]:   <metadata>
Oct 17 12:12:07 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:12:07 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:12:07 user nova-compute[74261]:       <nova:name>tempest-TestShelveInstance-server-1063978881</nova:name>
Oct 17 12:12:07 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:12:05</nova:creationTime>
Oct 17 12:12:07 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:12:07 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:12:07 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:12:07 user nova-compute[74261]:       <nova:owner>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:user uuid="236acb378dd5414d9da0402b28550a4f">tempest-TestShelveInstance-1038321046-project-member</nova:user>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:project uuid="2b7d085514a94bc08f49773b28b92d86">tempest-TestShelveInstance-1038321046</nova:project>
Oct 17 12:12:07 user nova-compute[74261]:       </nova:owner>
Oct 17 12:12:07 user nova-compute[74261]:       <nova:ports>
Oct 17 12:12:07 user nova-compute[74261]:         <nova:port uuid="793feba2-6044-4088-ada0-82adb93b9d3f">
Oct 17 12:12:07 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 12:12:07 user nova-compute[74261]:         </nova:port>
Oct 17 12:12:07 user nova-compute[74261]:       </nova:ports>
Oct 17 12:12:07 user nova-compute[74261]:     </nova:instance>
Oct 17 12:12:07 user nova-compute[74261]:   </metadata>
Oct 17 12:12:07 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:12:07 user nova-compute[74261]:     <system>
Oct 17 12:12:07 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:12:07 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:12:07 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:12:07 user nova-compute[74261]:       <entry name="serial">85b00045-b0be-4a06-9930-3d2950bde8a6</entry>
Oct 17 12:12:07 user nova-compute[74261]:       <entry name="uuid">85b00045-b0be-4a06-9930-3d2950bde8a6</entry>
Oct 17 12:12:07 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:12:07 user nova-compute[74261]:     </system>
Oct 17 12:12:07 user nova-compute[74261]:   </sysinfo>
Oct 17 12:12:07 user nova-compute[74261]:   <os>
Oct 17 12:12:07 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:12:07 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:12:07 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:12:07 user nova-compute[74261]:   </os>
Oct 17 12:12:07 user nova-compute[74261]:   <features>
Oct 17 12:12:07 user nova-compute[74261]:     <acpi/>
Oct 17 12:12:07 user nova-compute[74261]:     <apic/>
Oct 17 12:12:07 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:12:07 user nova-compute[74261]:   </features>
Oct 17 12:12:07 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:12:07 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:12:07 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:12:07 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:12:07 user nova-compute[74261]:   </clock>
Oct 17 12:12:07 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:12:07 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:12:07 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:12:07 user nova-compute[74261]:   </cpu>
Oct 17 12:12:07 user nova-compute[74261]:   <devices>
Oct 17 12:12:07 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:12:07 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:12:07 user nova-compute[74261]:       <source dev="/dev/sdc"/>
Oct 17 12:12:07 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:12:07 user nova-compute[74261]:       <serial>6dd8ffe3-9b66-4d52-b390-b364d8fc2fab</serial>
Oct 17 12:12:07 user nova-compute[74261]:     </disk>
Oct 17 12:12:07 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:12:07 user nova-compute[74261]:       <mac address="fa:16:3e:33:38:e6"/>
Oct 17 12:12:07 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:12:07 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:12:07 user nova-compute[74261]:       <target dev="tap793feba2-60"/>
Oct 17 12:12:07 user nova-compute[74261]:     </interface>
Oct 17 12:12:07 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:12:07 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6/console.log" append="off"/>
Oct 17 12:12:07 user nova-compute[74261]:     </serial>
Oct 17 12:12:07 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:12:07 user nova-compute[74261]:     <video>
Oct 17 12:12:07 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:12:07 user nova-compute[74261]:     </video>
Oct 17 12:12:07 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:12:07 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:12:07 user nova-compute[74261]:     </rng>
Oct 17 12:12:07 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:12:07 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:12:07 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:12:07 user nova-compute[74261]:     </memballoon>
Oct 17 12:12:07 user nova-compute[74261]:   </devices>
Oct 17 12:12:07 user nova-compute[74261]: </domain>
Oct 17 12:12:07 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T12:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1063978881',display_name='tempest-TestShelveInstance-server-1063978881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1063978881',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1798180429',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b7d085514a94bc08f49773b28b92d86',ramdisk_id='',reservation_id='r-9co0384g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1038321046',owner_user_name='tempest-TestShelveInstance-1038321046-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:11:45Z,user_data=None,user_id='236acb378dd5414d9da0402b28550a4f',uuid=85b00045-b0be-4a06-9930-3d2950bde8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converting VIF {"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG os_vif [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1e2933a-b4cb-59fe-a28c-90cb1b35d6f6', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap793feba2-60, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap793feba2-60, col_values=(('qos', UUID('048fcd58-9b32-4435-ae72-2312a62792bf')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap793feba2-60, col_values=(('external_ids', {'iface-id': '793feba2-6044-4088-ada0-82adb93b9d3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:38:e6', 'vm-uuid': '85b00045-b0be-4a06-9930-3d2950bde8a6'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:07 user nova-compute[74261]: INFO os_vif [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60')
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:12:07 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] No VIF found with MAC fa:16:3e:33:38:e6, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-2ad6a9ca-ac79-423c-824d-c0e016788f4f req-d651d1de-c15c-41c3-bd48-42d61b277de5 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2ad6a9ca-ac79-423c-824d-c0e016788f4f req-d651d1de-c15c-41c3-bd48-42d61b277de5 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2ad6a9ca-ac79-423c-824d-c0e016788f4f req-d651d1de-c15c-41c3-bd48-42d61b277de5 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2ad6a9ca-ac79-423c-824d-c0e016788f4f req-d651d1de-c15c-41c3-bd48-42d61b277de5 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-2ad6a9ca-ac79-423c-824d-c0e016788f4f req-d651d1de-c15c-41c3-bd48-42d61b277de5 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:12:08 user nova-compute[74261]: WARNING nova.compute.manager [req-2ad6a9ca-ac79-423c-824d-c0e016788f4f req-d651d1de-c15c-41c3-bd48-42d61b277de5 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 12:12:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:12:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance spawned successfully.
Oct 17 12:12:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-8a3f22c3-6bfc-413b-91de-9d555539129d tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.448s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-dcac7132-908e-4a4e-a385-2e6cb586ccd0 req-82f6e74a-96b6-4787-8b8a-e009f745e1dd service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dcac7132-908e-4a4e-a385-2e6cb586ccd0 req-82f6e74a-96b6-4787-8b8a-e009f745e1dd service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dcac7132-908e-4a4e-a385-2e6cb586ccd0 req-82f6e74a-96b6-4787-8b8a-e009f745e1dd service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dcac7132-908e-4a4e-a385-2e6cb586ccd0 req-82f6e74a-96b6-4787-8b8a-e009f745e1dd service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:10 user nova-compute[74261]: DEBUG nova.compute.manager [req-dcac7132-908e-4a4e-a385-2e6cb586ccd0 req-82f6e74a-96b6-4787-8b8a-e009f745e1dd service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:12:10 user nova-compute[74261]: WARNING nova.compute.manager [req-dcac7132-908e-4a4e-a385-2e6cb586ccd0 req-82f6e74a-96b6-4787-8b8a-e009f745e1dd service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state None.
Oct 17 12:12:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:13 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:14 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:12:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:12:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:12:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:12:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:12:18 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:19 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:12:19 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=25.21792221069336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 85b00045-b0be-4a06-9930-3d2950bde8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:12:19 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:12:20 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:12:20 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:12:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:12:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:12:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:12:27 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating instance_info_cache with network_info: [{"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:12:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-78fe14a5-64c3-486f-b3b8-9c087a4bbfad" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:12:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:12:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:12:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:12:57 user nova-compute[74261]: INFO nova.compute.claims [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Claim successful on node user
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:12:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.policy [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '180638ab7be5488285bb8900a233482c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4461d212c834e488059b733cfa0d7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:12:57 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Creating image(s)
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "/opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "/opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "/opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:57 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk 1073741824" returned: 0 in 0.053s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Cannot resize image /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Ensure instance console log exists: /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:12:58 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Successfully created port: cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Successfully updated port: cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "refresh_cache-1657225e-e480-43d5-8d9e-166eb0c2aa8c" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquired lock "refresh_cache-1657225e-e480-43d5-8d9e-166eb0c2aa8c" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-changed-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.compute.manager [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Refreshing instance network info cache due to event network-changed-cafab7ba-9747-426d-afae-b7cbb6b18528. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] Acquiring lock "refresh_cache-1657225e-e480-43d5-8d9e-166eb0c2aa8c" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Updating instance_info_cache with network_info: [{"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Releasing lock "refresh_cache-1657225e-e480-43d5-8d9e-166eb0c2aa8c" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Instance network_info: |[{"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] Acquired lock "refresh_cache-1657225e-e480-43d5-8d9e-166eb0c2aa8c" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Refreshing network info cache for port cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Start _get_guest_xml network_info=[{"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:12:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:12:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-824593389',display_name='tempest-VolumesActionsTest-instance-824593389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-824593389',id=42,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4461d212c834e488059b733cfa0d7a6',ramdisk_id='',reservation_id='r-zjxlnbeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-17699373',owner_user_name='tempest-VolumesActionsTest-17699373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:12:58Z,user_data=None,user_id='180638ab7be5488285bb8900a233482c',uuid=1657225e-e480-43d5-8d9e-166eb0c2aa8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converting VIF {"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lazy-loading 'pci_devices' on Instance uuid 1657225e-e480-43d5-8d9e-166eb0c2aa8c {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:12:59 user nova-compute[74261]:   <uuid>1657225e-e480-43d5-8d9e-166eb0c2aa8c</uuid>
Oct 17 12:12:59 user nova-compute[74261]:   <name>instance-0000002a</name>
Oct 17 12:12:59 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:12:59 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:12:59 user nova-compute[74261]:   <metadata>
Oct 17 12:12:59 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:12:59 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:12:59 user nova-compute[74261]:       <nova:name>tempest-VolumesActionsTest-instance-824593389</nova:name>
Oct 17 12:12:59 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:12:59</nova:creationTime>
Oct 17 12:12:59 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:12:59 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:12:59 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:12:59 user nova-compute[74261]:       <nova:owner>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:user uuid="180638ab7be5488285bb8900a233482c">tempest-VolumesActionsTest-17699373-project-member</nova:user>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:project uuid="c4461d212c834e488059b733cfa0d7a6">tempest-VolumesActionsTest-17699373</nova:project>
Oct 17 12:12:59 user nova-compute[74261]:       </nova:owner>
Oct 17 12:12:59 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:12:59 user nova-compute[74261]:       <nova:ports>
Oct 17 12:12:59 user nova-compute[74261]:         <nova:port uuid="cafab7ba-9747-426d-afae-b7cbb6b18528">
Oct 17 12:12:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 12:12:59 user nova-compute[74261]:         </nova:port>
Oct 17 12:12:59 user nova-compute[74261]:       </nova:ports>
Oct 17 12:12:59 user nova-compute[74261]:     </nova:instance>
Oct 17 12:12:59 user nova-compute[74261]:   </metadata>
Oct 17 12:12:59 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:12:59 user nova-compute[74261]:     <system>
Oct 17 12:12:59 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:12:59 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:12:59 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:12:59 user nova-compute[74261]:       <entry name="serial">1657225e-e480-43d5-8d9e-166eb0c2aa8c</entry>
Oct 17 12:12:59 user nova-compute[74261]:       <entry name="uuid">1657225e-e480-43d5-8d9e-166eb0c2aa8c</entry>
Oct 17 12:12:59 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:12:59 user nova-compute[74261]:     </system>
Oct 17 12:12:59 user nova-compute[74261]:   </sysinfo>
Oct 17 12:12:59 user nova-compute[74261]:   <os>
Oct 17 12:12:59 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:12:59 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:12:59 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:12:59 user nova-compute[74261]:   </os>
Oct 17 12:12:59 user nova-compute[74261]:   <features>
Oct 17 12:12:59 user nova-compute[74261]:     <acpi/>
Oct 17 12:12:59 user nova-compute[74261]:     <apic/>
Oct 17 12:12:59 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:12:59 user nova-compute[74261]:   </features>
Oct 17 12:12:59 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:12:59 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:12:59 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:12:59 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:12:59 user nova-compute[74261]:   </clock>
Oct 17 12:12:59 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:12:59 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:12:59 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:12:59 user nova-compute[74261]:   </cpu>
Oct 17 12:12:59 user nova-compute[74261]:   <devices>
Oct 17 12:12:59 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:12:59 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:12:59 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk"/>
Oct 17 12:12:59 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:12:59 user nova-compute[74261]:     </disk>
Oct 17 12:12:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:12:59 user nova-compute[74261]:       <mac address="fa:16:3e:0a:b5:16"/>
Oct 17 12:12:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:12:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:12:59 user nova-compute[74261]:       <target dev="tapcafab7ba-97"/>
Oct 17 12:12:59 user nova-compute[74261]:     </interface>
Oct 17 12:12:59 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:12:59 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/console.log" append="off"/>
Oct 17 12:12:59 user nova-compute[74261]:     </serial>
Oct 17 12:12:59 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:12:59 user nova-compute[74261]:     <video>
Oct 17 12:12:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:12:59 user nova-compute[74261]:     </video>
Oct 17 12:12:59 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:12:59 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:12:59 user nova-compute[74261]:     </rng>
Oct 17 12:12:59 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:12:59 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:12:59 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:12:59 user nova-compute[74261]:     </memballoon>
Oct 17 12:12:59 user nova-compute[74261]:   </devices>
Oct 17 12:12:59 user nova-compute[74261]: </domain>
Oct 17 12:12:59 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-824593389',display_name='tempest-VolumesActionsTest-instance-824593389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-824593389',id=42,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4461d212c834e488059b733cfa0d7a6',ramdisk_id='',reservation_id='r-zjxlnbeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-17699373',owner_user_name='tempest-VolumesActionsTest-17699373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:12:58Z,user_data=None,user_id='180638ab7be5488285bb8900a233482c',uuid=1657225e-e480-43d5-8d9e-166eb0c2aa8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converting VIF {"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG os_vif [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75c0ef45-05ee-5eb3-bcc9-a147363ff894', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcafab7ba-97, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcafab7ba-97, col_values=(('qos', UUID('e76b662a-9b2d-4b06-bb94-77c8ccb8bed3')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcafab7ba-97, col_values=(('external_ids', {'iface-id': 'cafab7ba-9747-426d-afae-b7cbb6b18528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:b5:16', 'vm-uuid': '1657225e-e480-43d5-8d9e-166eb0c2aa8c'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:12:59 user nova-compute[74261]: INFO os_vif [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97')
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] No VIF found with MAC fa:16:3e:0a:b5:16, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Updated VIF entry in instance network info cache for port cafab7ba-9747-426d-afae-b7cbb6b18528. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:12:59 user nova-compute[74261]: DEBUG nova.network.neutron [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Updating instance_info_cache with network_info: [{"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:13:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d32f6ced-29e1-427e-b5e8-0ed5c7ea20ed req-dfd6b663-c6af-4e8a-8b6c-b0dfec76df6d service nova] Releasing lock "refresh_cache-1657225e-e480-43d5-8d9e-166eb0c2aa8c" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-9407fe49-d295-496b-91d1-fa9a0e2d5fc0 req-46aba08e-9ae3-4d79-b959-f6b4348ac72d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9407fe49-d295-496b-91d1-fa9a0e2d5fc0 req-46aba08e-9ae3-4d79-b959-f6b4348ac72d service nova] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9407fe49-d295-496b-91d1-fa9a0e2d5fc0 req-46aba08e-9ae3-4d79-b959-f6b4348ac72d service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9407fe49-d295-496b-91d1-fa9a0e2d5fc0 req-46aba08e-9ae3-4d79-b959-f6b4348ac72d service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-9407fe49-d295-496b-91d1-fa9a0e2d5fc0 req-46aba08e-9ae3-4d79-b959-f6b4348ac72d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] No waiting events found dispatching network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:01 user nova-compute[74261]: WARNING nova.compute.manager [req-9407fe49-d295-496b-91d1-fa9a0e2d5fc0 req-46aba08e-9ae3-4d79-b959-f6b4348ac72d service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received unexpected event network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 for instance with vm_state building and task_state spawning.
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:03 user nova-compute[74261]: INFO nova.compute.manager [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Detaching volume 67eda876-8239-4cf5-b372-1fc4364b859b
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:13:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Instance spawned successfully.
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:13:03 user nova-compute[74261]: INFO nova.virt.block_device [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Attempting to driver detach volume 67eda876-8239-4cf5-b372-1fc4364b859b from mountpoint /dev/vdb
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Attempting to detach device vdb from instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:13:03 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:13:03 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:13:03 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:13:03 user nova-compute[74261]:   <serial>67eda876-8239-4cf5-b372-1fc4364b859b</serial>
Oct 17 12:13:03 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:13:03 user nova-compute[74261]: </disk>
Oct 17 12:13:03 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully detached device vdb from instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad from the persistent domain config.
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:13:03 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:13:03 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:13:03 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:13:03 user nova-compute[74261]:   <serial>67eda876-8239-4cf5-b372-1fc4364b859b</serial>
Oct 17 12:13:03 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:13:03 user nova-compute[74261]: </disk>
Oct 17 12:13:03 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:13:03 user nova-compute[74261]: INFO nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:13:03 user nova-compute[74261]: INFO nova.compute.manager [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Took 6.17 seconds to build instance.
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d79257da-3f3a-4019-9d81-62899fc418f9 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.263s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-57e36f45-dd67-42ba-904b-78c0d44df23d req-1a46d7cd-7545-4872-b8bc-9b3e7cb0cb6c service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-57e36f45-dd67-42ba-904b-78c0d44df23d req-1a46d7cd-7545-4872-b8bc-9b3e7cb0cb6c service nova] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-57e36f45-dd67-42ba-904b-78c0d44df23d req-1a46d7cd-7545-4872-b8bc-9b3e7cb0cb6c service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-57e36f45-dd67-42ba-904b-78c0d44df23d req-1a46d7cd-7545-4872-b8bc-9b3e7cb0cb6c service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-57e36f45-dd67-42ba-904b-78c0d44df23d req-1a46d7cd-7545-4872-b8bc-9b3e7cb0cb6c service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] No waiting events found dispatching network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:03 user nova-compute[74261]: WARNING nova.compute.manager [req-57e36f45-dd67-42ba-904b-78c0d44df23d req-1a46d7cd-7545-4872-b8bc-9b3e7cb0cb6c service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received unexpected event network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 for instance with vm_state active and task_state None.
Oct 17 12:13:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:13:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-changed-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG nova.compute.manager [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Refreshing instance network info cache due to event network-changed-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Refreshing network info cache for port 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated VIF entry in instance network info cache for port 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG nova.network.neutron [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ac749573-c14f-4a9f-a160-e504626e8cff req-763247c3-e567-41ca-93e4-46231dcf307b service nova] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:13:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG nova.objects.instance [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:17 user nova-compute[74261]: INFO nova.compute.manager [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attaching volume c23de073-ce12-4768-bc07-140d44e24a26 to /dev/vdb
Oct 17 12:13:17 user nova-compute[74261]: DEBUG os_brick.utils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a3928-3a1b-44b1-a2c9-9ee2301fd594]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[86370b34-4fc3-4516-8310-d8ed9a87ce57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ea063-4429-48e5-9b04-ce807ec219d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f8ed5-f152-461a-b7e3-e7bb8a23466c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:13:17 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:13:17 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9f923f-88d5-4334-bff9-cbf6b0ab66e6]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG os_brick.utils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:13:17 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating existing volume attachment record: f01ed25f-51bb-4aa1-b937-80613db2466b {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:19 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:13:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=25.188289642333984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 85b00045-b0be-4a06-9930-3d2950bde8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1657225e-e480-43d5-8d9e-166eb0c2aa8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:13:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:23 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad is timed out.
Oct 17 12:13:23 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully detached device vdb from instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad from the live domain config.
Oct 17 12:13:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYxeNFnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:13:23 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6602e5bd-d7a1-4ec6-b04e-82c988c1b1a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:13:23 user nova-compute[74261]: No targets found.
Oct 17 12:13:23 user nova-compute[74261]: iSNS:
Oct 17 12:13:23 user nova-compute[74261]: No targets found.
Oct 17 12:13:23 user nova-compute[74261]: STATIC:
Oct 17 12:13:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b
Oct 17 12:13:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:13:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:13:23 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:13:23 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:13:23 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:13:23 user nova-compute[74261]: FIRMWARE:
Oct 17 12:13:23 user nova-compute[74261]: No targets found.
Oct 17 12:13:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:13:23 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:13:23 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d06c849-1d1e-4154-ab61-b6cf46ba078a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b8844-8b3f-41c4-9949-76195eb0de3c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:13:23 user nova-compute[74261]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b (non-flash)
Oct 17 12:13:23 user nova-compute[74261]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae8651240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a243649-7611-4949-82f0-3ef3daced173]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c98ed-a80b-484b-b815-02a2f7c94657]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[80064c24-7eb1-493f-900b-107f653dad47]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fcee84-5b57-4fd8-aa43-6314761ec1bc]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bee07cc-21f0-4c05-bbbf-08adb07b4285]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d371f-0c08-41dd-9690-4aa535becc56]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260]
Oct 17 12:13:23 user nova-compute[74261]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b, portal: 172.16.0.220,3260] successful.
Oct 17 12:13:23 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c77c9-6bfe-4a77-943f-2f75fcbe9129]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== disconnect_volume: return (276ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:13:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'flavor' on Instance uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b9db528a-37a7-4aa8-bf3c-d0751bd440e3 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.732s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.615s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:24 user nova-compute[74261]: INFO nova.compute.manager [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Terminating instance
Oct 17 12:13:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-f21f5215-cc52-48ca-a9c9-3d05544de88e req-1a075ae4-2a14-4a8a-bb8b-7e06ebf3b8a3 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-vif-unplugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f21f5215-cc52-48ca-a9c9-3d05544de88e req-1a075ae4-2a14-4a8a-bb8b-7e06ebf3b8a3 service nova] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f21f5215-cc52-48ca-a9c9-3d05544de88e req-1a075ae4-2a14-4a8a-bb8b-7e06ebf3b8a3 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-f21f5215-cc52-48ca-a9c9-3d05544de88e req-1a075ae4-2a14-4a8a-bb8b-7e06ebf3b8a3 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-f21f5215-cc52-48ca-a9c9-3d05544de88e req-1a075ae4-2a14-4a8a-bb8b-7e06ebf3b8a3 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] No waiting events found dispatching network-vif-unplugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-f21f5215-cc52-48ca-a9c9-3d05544de88e req-1a075ae4-2a14-4a8a-bb8b-7e06ebf3b8a3 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-vif-unplugged-05b924ff-b85c-4732-b0c4-12594e5c759c for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Instance destroyed successfully.
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.objects.instance [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'resources' on Instance uuid 78fe14a5-64c3-486f-b3b8-9c087a4bbfad {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1000672693',display_name='tempest-VolumesSnapshotTestJSON-instance-1000672693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1000672693',id=40,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdJscglWN9VvzySMNQX8eKMtvcKEij/DM8InOVwpALhMK9AakjLRKj1Uc8saHPBEoaglixFTGTV0jWzb89lKA4r0b8QF9oOq6RdmbGPjiOHMVnggKzzhzvjZhZfVIh/+Q==',key_name='tempest-keypair-2002492860',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:09:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d347c39d44761af3558abf37f7822',ramdisk_id='',reservation_id='r-2yv40woz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1072624135',owner_user_name='tempest-VolumesSnapshotTestJSON-1072624135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:09:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539289bce741475693adef12bd561c95',uuid=78fe14a5-64c3-486f-b3b8-9c087a4bbfad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converting VIF {"id": "05b924ff-b85c-4732-b0c4-12594e5c759c", "address": "fa:16:3e:b1:d5:72", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b924ff-b8", "ovs_interfaceid": "05b924ff-b85c-4732-b0c4-12594e5c759c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_vif [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05b924ff-b8, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9120f0be-ff2c-44d1-9f38-947a1d8c9dd3) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:25 user nova-compute[74261]: INFO os_vif [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d5:72,bridge_name='br-int',has_traffic_filtering=True,id=05b924ff-b85c-4732-b0c4-12594e5c759c,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b924ff-b8')
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYxeNFnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:13:25 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f82ee82-c785-4e12-a6ed-c6c6208c5f22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:13:25 user nova-compute[74261]: No targets found.
Oct 17 12:13:25 user nova-compute[74261]: iSNS:
Oct 17 12:13:25 user nova-compute[74261]: No targets found.
Oct 17 12:13:25 user nova-compute[74261]: STATIC:
Oct 17 12:13:25 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:13:25 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:13:25 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:13:25 user nova-compute[74261]: FIRMWARE:
Oct 17 12:13:25 user nova-compute[74261]: No targets found.
Oct 17 12:13:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:13:25 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:13:25 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eda876-8239-4cf5-b372-1fc4364b859b', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2555ae84-a01f-4dbb-b49a-a4463593dd2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1f21b6-0f17-4dd3-ab81-a330dd0611ca]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae8651bd0>, {}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Disconnecting from: [] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== disconnect_volume: return (71ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:13:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Deleting instance files /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad_del
Oct 17 12:13:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Deletion of /opt/stack/data/nova/instances/78fe14a5-64c3-486f-b3b8-9c087a4bbfad_del complete
Oct 17 12:13:25 user nova-compute[74261]: INFO nova.compute.manager [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 17 12:13:25 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:13:25 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:13:26 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:13:26 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Took 0.81 seconds to deallocate network for instance.
Oct 17 12:13:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-138dd938-cb57-473d-aff6-cafed57a3253 req-70b29b01-09df-47ae-9e7e-8500c48d0940 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-vif-deleted-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:26 user nova-compute[74261]: WARNING nova.volume.cinder [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Attachment 0d282ee6-7b87-41ee-a1e2-ff2d4f4249c3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0d282ee6-7b87-41ee-a1e2-ff2d4f4249c3. (HTTP 404) (Request-ID: req-7a37350c-f395-40a5-9051-0ecf6da9a47d)
Oct 17 12:13:26 user nova-compute[74261]: INFO nova.compute.manager [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Took 0.02 seconds to detach 1 volumes for instance.
Oct 17 12:13:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:26 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:13:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:13:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:26 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Deleted allocations for instance 78fe14a5-64c3-486f-b3b8-9c087a4bbfad
Oct 17 12:13:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-55f611eb-9484-4b7b-8a5a-1263bb554f12 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.114s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-05a08380-b7e5-4e5a-b9fb-32d61e58d887 req-2f8b568b-250d-4007-a124-7f718728db29 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received event network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-05a08380-b7e5-4e5a-b9fb-32d61e58d887 req-2f8b568b-250d-4007-a124-7f718728db29 service nova] Acquiring lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-05a08380-b7e5-4e5a-b9fb-32d61e58d887 req-2f8b568b-250d-4007-a124-7f718728db29 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-05a08380-b7e5-4e5a-b9fb-32d61e58d887 req-2f8b568b-250d-4007-a124-7f718728db29 service nova] Lock "78fe14a5-64c3-486f-b3b8-9c087a4bbfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG nova.compute.manager [req-05a08380-b7e5-4e5a-b9fb-32d61e58d887 req-2f8b568b-250d-4007-a124-7f718728db29 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] No waiting events found dispatching network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:27 user nova-compute[74261]: WARNING nova.compute.manager [req-05a08380-b7e5-4e5a-b9fb-32d61e58d887 req-2f8b568b-250d-4007-a124-7f718728db29 service nova] [instance: 78fe14a5-64c3-486f-b3b8-9c087a4bbfad] Received unexpected event network-vif-plugged-05b924ff-b85c-4732-b0c4-12594e5c759c for instance with vm_state deleted and task_state None.
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:13:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:13:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVjZYcJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:13:33 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:13:33 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:13:33 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad918d6-4ded-47b2-beb5-ae94fee3bcf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:13:33 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[026e2d76-99eb-4361-9ded-b9b10370f049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26] added
Oct 17 12:13:33 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4b9c0-19ef-444a-ae55-9d4901dea73f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dae4f9-5904-4e76-bef8-fd3404139ee9]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVjZYcJu {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVjZYcJu" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0517f-ac14-4253-9b15-65f8729e4609]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVjZYcJu'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8f403-6748-446a-8501-b95ed91c13f4]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c1a13-2d40-4158-b665-7d9486dea9b8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:33 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:33 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ef72ec-b95f-4249-8743-7d32f9fe37cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260]
Oct 17 12:13:33 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260] successful.
Oct 17 12:13:33 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccfb5ef-f3ac-46ad-9810-fbfabfdab9c5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d16fa7-a1ec-4fa0-9eeb-170c05713369]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:33 user nova-compute[74261]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)
Oct 17 12:13:33 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:33 user nova-compute[74261]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)
Oct 17 12:13:33 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5483114f-7626-4796-bcf4-af41dbf3b4f0]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:33 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVjZYcJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23233393162666161', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233393162666161', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG nova.objects.instance [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:13:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:13:34 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:13:34 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:13:34 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:13:34 user nova-compute[74261]:   <serial>c23de073-ce12-4768-bc07-140d44e24a26</serial>
Oct 17 12:13:34 user nova-compute[74261]: </disk>
Oct 17 12:13:34 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing instance network info cache due to event network-changed-793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] Acquiring lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] Acquired lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Refreshing network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No VIF found with MAC fa:16:3e:31:38:cf, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:35 user nova-compute[74261]: INFO nova.compute.manager [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Terminating instance
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-277f33dd-73a8-402c-a349-a559f948fcf0 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.320s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ae42aa0-8d72-40e0-a175-2bb3668bc177 req-c53e877e-8e21-4db5-97ca-e6e2bb251d60 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ae42aa0-8d72-40e0-a175-2bb3668bc177 req-c53e877e-8e21-4db5-97ca-e6e2bb251d60 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ae42aa0-8d72-40e0-a175-2bb3668bc177 req-c53e877e-8e21-4db5-97ca-e6e2bb251d60 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7ae42aa0-8d72-40e0-a175-2bb3668bc177 req-c53e877e-8e21-4db5-97ca-e6e2bb251d60 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ae42aa0-8d72-40e0-a175-2bb3668bc177 req-c53e877e-8e21-4db5-97ca-e6e2bb251d60 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-7ae42aa0-8d72-40e0-a175-2bb3668bc177 req-c53e877e-8e21-4db5-97ca-e6e2bb251d60 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updated VIF entry in instance network info cache for port 793feba2-6044-4088-ada0-82adb93b9d3f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [{"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:13:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4bee8322-0765-48a1-b2c9-3e880c11962a req-98727733-d7b3-411f-8418-03d20a4f9e36 service nova] Releasing lock "refresh_cache-85b00045-b0be-4a06-9930-3d2950bde8a6" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Instance destroyed successfully.
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lazy-loading 'resources' on Instance uuid 85b00045-b0be-4a06-9930-3d2950bde8a6 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T12:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1063978881',display_name='tempest-TestShelveInstance-server-1063978881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1063978881',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrTUUeK6d576D9Wi7TY+mmNKRECFGNY6cDZ0WkMgsYIe3SVO+Je/Ha74c5BJoREGP2jz3v3y8VEpS+xufvGin7NbE+IB0xqAI7jEH6pIbRjrVdH61ocBm5U2vD06IMmUw==',key_name='tempest-TestShelveInstance-1798180429',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:12:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b7d085514a94bc08f49773b28b92d86',ramdisk_id='',reservation_id='r-9co0384g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1038321046',owner_user_name='tempest-TestShelveInstance-1038321046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:12:11Z,user_data=None,user_id='236acb378dd5414d9da0402b28550a4f',uuid=85b00045-b0be-4a06-9930-3d2950bde8a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converting VIF {"id": "793feba2-6044-4088-ada0-82adb93b9d3f", "address": "fa:16:3e:33:38:e6", "network": {"id": "81976d01-9c83-4a27-849e-17a7328b040f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1092920826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7d085514a94bc08f49773b28b92d86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793feba2-60", "ovs_interfaceid": "793feba2-6044-4088-ada0-82adb93b9d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_vif [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap793feba2-60, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=048fcd58-9b32-4435-ae72-2312a62792bf) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:13:36 user nova-compute[74261]: INFO os_vif [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=793feba2-6044-4088-ada0-82adb93b9d3f,network=Network(81976d01-9c83-4a27-849e-17a7328b040f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793feba2-60')
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQKpnwEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:13:36 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[75abf542-7962-45cf-9d3c-f1f6976992ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:13:36 user nova-compute[74261]: No targets found.
Oct 17 12:13:36 user nova-compute[74261]: iSNS:
Oct 17 12:13:36 user nova-compute[74261]: No targets found.
Oct 17 12:13:36 user nova-compute[74261]: STATIC:
Oct 17 12:13:36 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26
Oct 17 12:13:36 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:13:36 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:13:36 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab
Oct 17 12:13:36 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:13:36 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:13:36 user nova-compute[74261]: FIRMWARE:
Oct 17 12:13:36 user nova-compute[74261]: No targets found.
Oct 17 12:13:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:13:36 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:13:36 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d445fe9-d738-488a-90d5-e7909d2e648b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d82a19-741f-4def-8d6b-387fbcb9db8e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:36 user nova-compute[74261]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)
Oct 17 12:13:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab (non-flash)
Oct 17 12:13:36 user nova-compute[74261]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)
Oct 17 12:13:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae8650940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f182b269-b041-4c1a-8b6e-2d06b9d3a9b1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ac5293-f477-4a9b-8136-0181320b2d39]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab11822c-f9db-482a-8707-5056c0dbec4d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b4e0b-ce6e-47f6-b0a7-ec41955185ab]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9e94487', '/dev/disk/by-id/scsi-1SCST_BIOf9e94487-43e2848caeae564d', '/dev/disk/by-id/scsi-23433653238343863') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f45497-cf0e-4e64-b2d4-07cef96096e4]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[facd3269-e8f0-4321-b2b6-d95c39e689cb]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88d77e-8ccc-4f7f-b003-eba8a2c2d905]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260]
Oct 17 12:13:36 user nova-compute[74261]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab, portal: 172.16.0.220,3260] successful.
Oct 17 12:13:36 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd8ffe3-9b66-4d52-b390-b364d8fc2fab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d4caa1-838f-4e33-870f-3831c920bf63]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] <== disconnect_volume: return (357ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:13:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Deleting instance files /opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6_del
Oct 17 12:13:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Deletion of /opt/stack/data/nova/instances/85b00045-b0be-4a06-9930-3d2950bde8a6_del complete
Oct 17 12:13:36 user nova-compute[74261]: INFO nova.compute.manager [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 17 12:13:36 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:13:37 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Took 0.60 seconds to deallocate network for instance.
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:37 user nova-compute[74261]: WARNING nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state deleting.
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:37 user nova-compute[74261]: WARNING nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state deleting.
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:37 user nova-compute[74261]: WARNING nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state deleting.
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-unplugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Acquiring lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] No waiting events found dispatching network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:13:37 user nova-compute[74261]: WARNING nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received unexpected event network-vif-plugged-793feba2-6044-4088-ada0-82adb93b9d3f for instance with vm_state active and task_state deleting.
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-a871c17b-341b-4ecb-b141-ffcaf88bbf98 req-b44f3c0b-58e2-4fdf-88ba-e40e8adc2b62 service nova] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Received event network-vif-deleted-793feba2-6044-4088-ada0-82adb93b9d3f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:13:37 user nova-compute[74261]: INFO nova.compute.manager [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Took 0.78 seconds to detach 1 volumes for instance.
Oct 17 12:13:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] [instance: 85b00045-b0be-4a06-9930-3d2950bde8a6] Deleting volume: 6dd8ffe3-9b66-4d52-b390-b364d8fc2fab {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 12:13:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:13:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:13:38 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:13:38 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:13:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:38 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Deleted allocations for instance 85b00045-b0be-4a06-9930-3d2950bde8a6
Oct 17 12:13:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d04f11fe-b809-44ef-9c1d-628744fe05da tempest-TestShelveInstance-1038321046 tempest-TestShelveInstance-1038321046-project-member] Lock "85b00045-b0be-4a06-9930-3d2950bde8a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:13:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:13:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:08 user nova-compute[74261]: INFO nova.compute.manager [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Detaching volume c23de073-ce12-4768-bc07-140d44e24a26
Oct 17 12:14:08 user nova-compute[74261]: INFO nova.virt.block_device [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attempting to driver detach volume c23de073-ce12-4768-bc07-140d44e24a26 from mountpoint /dev/vdb
Oct 17 12:14:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Attempting to detach device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:14:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:14:08 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:14:08 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:14:08 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:14:08 user nova-compute[74261]:   <serial>c23de073-ce12-4768-bc07-140d44e24a26</serial>
Oct 17 12:14:08 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:14:08 user nova-compute[74261]: </disk>
Oct 17 12:14:08 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:14:08 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config.
Oct 17 12:14:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:14:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:14:08 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:14:08 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:14:08 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:14:08 user nova-compute[74261]:   <serial>c23de073-ce12-4768-bc07-140d44e24a26</serial>
Oct 17 12:14:08 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:14:08 user nova-compute[74261]: </disk>
Oct 17 12:14:08 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:14:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:14:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:14:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:14:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:14:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:14:21 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=25.204368591308594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 1657225e-e480-43d5-8d9e-166eb0c2aa8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:14:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:25 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:14:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:14:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:14:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:29 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 is timed out.
Oct 17 12:14:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config.
Oct 17 12:14:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVjZYcJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:14:29 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf4197c-3cc7-487d-ba7c-f0ac257c78f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:14:29 user nova-compute[74261]: No targets found.
Oct 17 12:14:29 user nova-compute[74261]: iSNS:
Oct 17 12:14:29 user nova-compute[74261]: No targets found.
Oct 17 12:14:29 user nova-compute[74261]: STATIC:
Oct 17 12:14:29 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26
Oct 17 12:14:29 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:14:29 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:14:29 user nova-compute[74261]: FIRMWARE:
Oct 17 12:14:29 user nova-compute[74261]: No targets found.
Oct 17 12:14:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:14:29 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:14:29 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4e6c3b-f21e-4977-96dd-80e568226d16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f228d-c5cb-4363-98b7-23afbb410a45]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)
Oct 17 12:14:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 (non-flash)
Oct 17 12:14:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24393130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c31720-e21f-41bb-837a-2da33993b61e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[380358da-0622-46bd-94f2-77260bc95ca8]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[669ff7be-dd64-462e-a964-f3824c753076]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d45cc4-4362-4ffa-b541-34d0c6ac8442]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085bf0d-e0ba-4022-8eef-e58c46de2f8d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb54fa7-87b8-439b-923a-d47322394256]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260]
Oct 17 12:14:29 user nova-compute[74261]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26, portal: 172.16.0.220,3260] successful.
Oct 17 12:14:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c23de073-ce12-4768-bc07-140d44e24a26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2578409b-5f90-46da-9398-a3c18846b730]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== disconnect_volume: return (300ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:14:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:14:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:14:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56711084-9b8a-4ca7-befd-df3907f41d86 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.938s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:14:33 user nova-compute[74261]: INFO nova.compute.claims [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Claim successful on node user
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:14:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.policy [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '539289bce741475693adef12bd561c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d347c39d44761af3558abf37f7822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:14:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Creating image(s)
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "/opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "/opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk 1073741824" returned: 0 in 0.051s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Successfully created port: 23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.197s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Cannot resize image /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Ensure instance console log exists: /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Successfully updated port: 23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquired lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-changed-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Refreshing instance network info cache due to event network-changed-23a5af7b-470f-4066-bfcc-8449889703e8. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] Acquiring lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updating instance_info_cache with network_info: [{"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Releasing lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Instance network_info: |[{"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] Acquired lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Refreshing network info cache for port 23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Start _get_guest_xml network_info=[{"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:14:35 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:14:35 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1839609459',display_name='tempest-VolumesSnapshotTestJSON-instance-1839609459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1839609459',id=43,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES4O7YFt9LVQAhLdQ1xUbSYeCR654mNYxF3J+1axuBoIclEzFW5908GkDYqBkwDQ8w6n8GEapooRR39Gv2IQbV/Wk8tunrZFBMT5kHFeIPJ2GHiye2CP9HiTCoLMwbjzg==',key_name='tempest-keypair-1483979433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d347c39d44761af3558abf37f7822',ramdisk_id='',reservation_id='r-g81wdhq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072624135',owner_user_name='tempest-VolumesSnapshotTestJSON-1072624135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:14:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539289bce741475693adef12bd561c95',uuid=7ed9302f-114d-4ddf-a151-6d6f2999976e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converting VIF {"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ed9302f-114d-4ddf-a151-6d6f2999976e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:14:35 user nova-compute[74261]:   <uuid>7ed9302f-114d-4ddf-a151-6d6f2999976e</uuid>
Oct 17 12:14:35 user nova-compute[74261]:   <name>instance-0000002b</name>
Oct 17 12:14:35 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:14:35 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:14:35 user nova-compute[74261]:   <metadata>
Oct 17 12:14:35 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:14:35 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:14:35 user nova-compute[74261]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1839609459</nova:name>
Oct 17 12:14:35 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:14:35</nova:creationTime>
Oct 17 12:14:35 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:14:35 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:14:35 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:14:35 user nova-compute[74261]:       <nova:owner>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:user uuid="539289bce741475693adef12bd561c95">tempest-VolumesSnapshotTestJSON-1072624135-project-member</nova:user>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:project uuid="457d347c39d44761af3558abf37f7822">tempest-VolumesSnapshotTestJSON-1072624135</nova:project>
Oct 17 12:14:35 user nova-compute[74261]:       </nova:owner>
Oct 17 12:14:35 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:14:35 user nova-compute[74261]:       <nova:ports>
Oct 17 12:14:35 user nova-compute[74261]:         <nova:port uuid="23a5af7b-470f-4066-bfcc-8449889703e8">
Oct 17 12:14:35 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 12:14:35 user nova-compute[74261]:         </nova:port>
Oct 17 12:14:35 user nova-compute[74261]:       </nova:ports>
Oct 17 12:14:35 user nova-compute[74261]:     </nova:instance>
Oct 17 12:14:35 user nova-compute[74261]:   </metadata>
Oct 17 12:14:35 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:14:35 user nova-compute[74261]:     <system>
Oct 17 12:14:35 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:14:35 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:14:35 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:14:35 user nova-compute[74261]:       <entry name="serial">7ed9302f-114d-4ddf-a151-6d6f2999976e</entry>
Oct 17 12:14:35 user nova-compute[74261]:       <entry name="uuid">7ed9302f-114d-4ddf-a151-6d6f2999976e</entry>
Oct 17 12:14:35 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:14:35 user nova-compute[74261]:     </system>
Oct 17 12:14:35 user nova-compute[74261]:   </sysinfo>
Oct 17 12:14:35 user nova-compute[74261]:   <os>
Oct 17 12:14:35 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:14:35 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:14:35 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:14:35 user nova-compute[74261]:   </os>
Oct 17 12:14:35 user nova-compute[74261]:   <features>
Oct 17 12:14:35 user nova-compute[74261]:     <acpi/>
Oct 17 12:14:35 user nova-compute[74261]:     <apic/>
Oct 17 12:14:35 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:14:35 user nova-compute[74261]:   </features>
Oct 17 12:14:35 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:14:35 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:14:35 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:14:35 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:14:35 user nova-compute[74261]:   </clock>
Oct 17 12:14:35 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:14:35 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:14:35 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:14:35 user nova-compute[74261]:   </cpu>
Oct 17 12:14:35 user nova-compute[74261]:   <devices>
Oct 17 12:14:35 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:14:35 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:14:35 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk"/>
Oct 17 12:14:35 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:14:35 user nova-compute[74261]:     </disk>
Oct 17 12:14:35 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:14:35 user nova-compute[74261]:       <mac address="fa:16:3e:f6:01:6e"/>
Oct 17 12:14:35 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:14:35 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:14:35 user nova-compute[74261]:       <target dev="tap23a5af7b-47"/>
Oct 17 12:14:35 user nova-compute[74261]:     </interface>
Oct 17 12:14:35 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:14:35 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/console.log" append="off"/>
Oct 17 12:14:35 user nova-compute[74261]:     </serial>
Oct 17 12:14:35 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:14:35 user nova-compute[74261]:     <video>
Oct 17 12:14:35 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:14:35 user nova-compute[74261]:     </video>
Oct 17 12:14:35 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:14:35 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:14:35 user nova-compute[74261]:     </rng>
Oct 17 12:14:35 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:14:35 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:14:35 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:14:35 user nova-compute[74261]:     </memballoon>
Oct 17 12:14:35 user nova-compute[74261]:   </devices>
Oct 17 12:14:35 user nova-compute[74261]: </domain>
Oct 17 12:14:35 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1839609459',display_name='tempest-VolumesSnapshotTestJSON-instance-1839609459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1839609459',id=43,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES4O7YFt9LVQAhLdQ1xUbSYeCR654mNYxF3J+1axuBoIclEzFW5908GkDYqBkwDQ8w6n8GEapooRR39Gv2IQbV/Wk8tunrZFBMT5kHFeIPJ2GHiye2CP9HiTCoLMwbjzg==',key_name='tempest-keypair-1483979433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d347c39d44761af3558abf37f7822',ramdisk_id='',reservation_id='r-g81wdhq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072624135',owner_user_name='tempest-VolumesSnapshotTestJSON-1072624135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:14:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539289bce741475693adef12bd561c95',uuid=7ed9302f-114d-4ddf-a151-6d6f2999976e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converting VIF {"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG os_vif [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce6b8438-7d3a-57a7-9905-943797ea2b52', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23a5af7b-47, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23a5af7b-47, col_values=(('qos', UUID('b7eec02d-137b-4572-8899-b01830f3908b')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23a5af7b-47, col_values=(('external_ids', {'iface-id': '23a5af7b-470f-4066-bfcc-8449889703e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:01:6e', 'vm-uuid': '7ed9302f-114d-4ddf-a151-6d6f2999976e'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:35 user nova-compute[74261]: INFO os_vif [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47')
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No VIF found with MAC fa:16:3e:f6:01:6e, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updated VIF entry in instance network info cache for port 23a5af7b-470f-4066-bfcc-8449889703e8. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updating instance_info_cache with network_info: [{"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:14:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6f5a6fb3-c540-4e79-adb2-eef9d049615a req-faf8cd34-2204-4d69-99cf-8010c8e8c17c service nova] Releasing lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:14:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-6038f6f9-d083-4285-9ec5-de30f7eacda9 req-10ce173e-10da-42e0-b207-d3e71c98c2ae service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6038f6f9-d083-4285-9ec5-de30f7eacda9 req-10ce173e-10da-42e0-b207-d3e71c98c2ae service nova] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6038f6f9-d083-4285-9ec5-de30f7eacda9 req-10ce173e-10da-42e0-b207-d3e71c98c2ae service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6038f6f9-d083-4285-9ec5-de30f7eacda9 req-10ce173e-10da-42e0-b207-d3e71c98c2ae service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-6038f6f9-d083-4285-9ec5-de30f7eacda9 req-10ce173e-10da-42e0-b207-d3e71c98c2ae service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] No waiting events found dispatching network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:14:37 user nova-compute[74261]: WARNING nova.compute.manager [req-6038f6f9-d083-4285-9ec5-de30f7eacda9 req-10ce173e-10da-42e0-b207-d3e71c98c2ae service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received unexpected event network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 for instance with vm_state building and task_state spawning.
Oct 17 12:14:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:14:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Instance spawned successfully.
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:14:39 user nova-compute[74261]: INFO nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-0e2dff87-624d-4884-87b3-3d0d837a4f7a req-27e69acd-17c8-41f6-bc08-8486d3d2ae7a service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0e2dff87-624d-4884-87b3-3d0d837a4f7a req-27e69acd-17c8-41f6-bc08-8486d3d2ae7a service nova] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0e2dff87-624d-4884-87b3-3d0d837a4f7a req-27e69acd-17c8-41f6-bc08-8486d3d2ae7a service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0e2dff87-624d-4884-87b3-3d0d837a4f7a req-27e69acd-17c8-41f6-bc08-8486d3d2ae7a service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-0e2dff87-624d-4884-87b3-3d0d837a4f7a req-27e69acd-17c8-41f6-bc08-8486d3d2ae7a service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] No waiting events found dispatching network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:14:39 user nova-compute[74261]: WARNING nova.compute.manager [req-0e2dff87-624d-4884-87b3-3d0d837a4f7a req-27e69acd-17c8-41f6-bc08-8486d3d2ae7a service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received unexpected event network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 for instance with vm_state building and task_state spawning.
Oct 17 12:14:39 user nova-compute[74261]: INFO nova.compute.manager [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Took 5.94 seconds to build instance.
Oct 17 12:14:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f8d955ce-e193-4586-ac8f-984031d77bb6 tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.037s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:47 user nova-compute[74261]: INFO nova.compute.manager [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Terminating instance
Oct 17 12:14:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c68becd7-73fd-43b9-be63-e59974961e72 req-732c95fa-8832-4b17-8625-9fc26b6d19c1 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-vif-unplugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c68becd7-73fd-43b9-be63-e59974961e72 req-732c95fa-8832-4b17-8625-9fc26b6d19c1 service nova] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c68becd7-73fd-43b9-be63-e59974961e72 req-732c95fa-8832-4b17-8625-9fc26b6d19c1 service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c68becd7-73fd-43b9-be63-e59974961e72 req-732c95fa-8832-4b17-8625-9fc26b6d19c1 service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c68becd7-73fd-43b9-be63-e59974961e72 req-732c95fa-8832-4b17-8625-9fc26b6d19c1 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] No waiting events found dispatching network-vif-unplugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-c68becd7-73fd-43b9-be63-e59974961e72 req-732c95fa-8832-4b17-8625-9fc26b6d19c1 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-vif-unplugged-cafab7ba-9747-426d-afae-b7cbb6b18528 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:14:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Instance destroyed successfully.
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lazy-loading 'resources' on Instance uuid 1657225e-e480-43d5-8d9e-166eb0c2aa8c {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-824593389',display_name='tempest-VolumesActionsTest-instance-824593389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-824593389',id=42,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4461d212c834e488059b733cfa0d7a6',ramdisk_id='',reservation_id='r-zjxlnbeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-17699373',owner_user_name='tempest-VolumesActionsTest-17699373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:13:03Z,user_data=None,user_id='180638ab7be5488285bb8900a233482c',uuid=1657225e-e480-43d5-8d9e-166eb0c2aa8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converting VIF {"id": "cafab7ba-9747-426d-afae-b7cbb6b18528", "address": "fa:16:3e:0a:b5:16", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafab7ba-97", "ovs_interfaceid": "cafab7ba-9747-426d-afae-b7cbb6b18528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG os_vif [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcafab7ba-97, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e76b662a-9b2d-4b06-bb94-77c8ccb8bed3) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:14:48 user nova-compute[74261]: INFO os_vif [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:b5:16,bridge_name='br-int',has_traffic_filtering=True,id=cafab7ba-9747-426d-afae-b7cbb6b18528,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafab7ba-97')
Oct 17 12:14:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Deleting instance files /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c_del
Oct 17 12:14:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Deletion of /opt/stack/data/nova/instances/1657225e-e480-43d5-8d9e-166eb0c2aa8c_del complete
Oct 17 12:14:48 user nova-compute[74261]: INFO nova.compute.manager [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 17 12:14:48 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:14:48 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-40ccd8d8-ccc6-4b64-ab83-ce4c177906ff req-1d6622a6-566d-418e-ab9f-41c836fc0935 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-vif-deleted-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:14:49 user nova-compute[74261]: INFO nova.compute.manager [req-40ccd8d8-ccc6-4b64-ab83-ce4c177906ff req-1d6622a6-566d-418e-ab9f-41c836fc0935 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Neutron deleted interface cafab7ba-9747-426d-afae-b7cbb6b18528; detaching it from the instance and deleting it from the info cache
Oct 17 12:14:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-40ccd8d8-ccc6-4b64-ab83-ce4c177906ff req-1d6622a6-566d-418e-ab9f-41c836fc0935 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:14:49 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Took 0.55 seconds to deallocate network for instance.
Oct 17 12:14:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-40ccd8d8-ccc6-4b64-ab83-ce4c177906ff req-1d6622a6-566d-418e-ab9f-41c836fc0935 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Detach interface failed, port_id=cafab7ba-9747-426d-afae-b7cbb6b18528, reason: Instance 1657225e-e480-43d5-8d9e-166eb0c2aa8c could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:14:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:49 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Deleted allocations for instance 1657225e-e480-43d5-8d9e-166eb0c2aa8c
Oct 17 12:14:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c5548da1-7d6b-45a0-b8dc-c98978db2f5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.557s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-1ff843e7-6166-4042-ae17-7ada3b21561d req-aeae91b5-a939-46cc-a69c-7a65538c0b59 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received event network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:14:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1ff843e7-6166-4042-ae17-7ada3b21561d req-aeae91b5-a939-46cc-a69c-7a65538c0b59 service nova] Acquiring lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:14:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1ff843e7-6166-4042-ae17-7ada3b21561d req-aeae91b5-a939-46cc-a69c-7a65538c0b59 service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:14:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1ff843e7-6166-4042-ae17-7ada3b21561d req-aeae91b5-a939-46cc-a69c-7a65538c0b59 service nova] Lock "1657225e-e480-43d5-8d9e-166eb0c2aa8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:14:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-1ff843e7-6166-4042-ae17-7ada3b21561d req-aeae91b5-a939-46cc-a69c-7a65538c0b59 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] No waiting events found dispatching network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:14:50 user nova-compute[74261]: WARNING nova.compute.manager [req-1ff843e7-6166-4042-ae17-7ada3b21561d req-aeae91b5-a939-46cc-a69c-7a65538c0b59 service nova] [instance: 1657225e-e480-43d5-8d9e-166eb0c2aa8c] Received unexpected event network-vif-plugged-cafab7ba-9747-426d-afae-b7cbb6b18528 for instance with vm_state deleted and task_state None.
Oct 17 12:14:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:14:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:04 user nova-compute[74261]: INFO nova.compute.manager [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attaching volume 419a4e33-d745-45c1-97e7-d93337798970 to /dev/vdb
Oct 17 12:15:04 user nova-compute[74261]: DEBUG os_brick.utils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f04ed-79c7-49b4-a76a-6ac18bdfd229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c60e1e-74b5-4577-8c35-3faba270c7c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b73f1-0067-4794-ac29-1392497e0b19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d289321b-b0c1-472a-8876-eb49b12bd218]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:15:04 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:15:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a7f885-a567-4a63-b954-c5accfad4aa0]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG os_brick.utils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:15:04 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating existing volume attachment record: 1279faff-a0b1-4aba-9d4c-586291e8736d {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:15:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:15 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:23 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:15:23 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.201126098632812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7ed9302f-114d-4ddf-a151-6d6f2999976e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:15:23 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:15:24 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:15:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:15:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJKlCVOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:15:29 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:15:29 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:15:29 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5a1970-14b1-494c-a4a1-00c9f6e77ddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:15:29 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a198a7-a29a-4798-a6f3-94a457d21e4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970] added
Oct 17 12:15:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e783d3-09ec-4c04-803f-55913fed2774]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87746431-02c8-4996-9283-ab97f6e6b30c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJKlCVOI {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJKlCVOI" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb6e27d-d514-416f-bcd5-dd70ed2989be]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJKlCVOI'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e65a9c0-db80-493a-8a56-9a5770efc615]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee3814c-8da2-4517-875a-8b99bfdbd20d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:15:29 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:15:29 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:15:29 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:15:29 user nova-compute[74261]: 
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e8502-d822-4b86-8c0c-4b027da6591a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260]
Oct 17 12:15:29 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260] successful.
Oct 17 12:15:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1349560-7081-4f1c-8f37-bb911cb69f8a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62ced0-ef3f-4655-a52f-fbcf4d0d22ac]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 (non-flash)
Oct 17 12:15:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 (non-flash)
Oct 17 12:15:29 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e35210-88bb-4269-89c7-19b9c1011130]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJKlCVOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:15:29 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23730393332353664', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730393332353664', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:15:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:15:30 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:15:30 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:15:30 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:15:30 user nova-compute[74261]:   <serial>419a4e33-d745-45c1-97e7-d93337798970</serial>
Oct 17 12:15:30 user nova-compute[74261]: </disk>
Oct 17 12:15:30 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:15:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:15:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:15:31 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No VIF found with MAC fa:16:3e:31:38:cf, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:15:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d4350d9a-1040-49a2-9426-a885403ad0ac tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.997s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:33 user nova-compute[74261]: INFO nova.compute.manager [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Detaching volume 419a4e33-d745-45c1-97e7-d93337798970
Oct 17 12:15:34 user nova-compute[74261]: INFO nova.virt.block_device [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attempting to driver detach volume 419a4e33-d745-45c1-97e7-d93337798970 from mountpoint /dev/vdb
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Attempting to detach device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:15:34 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:15:34 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:15:34 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:15:34 user nova-compute[74261]:   <serial>419a4e33-d745-45c1-97e7-d93337798970</serial>
Oct 17 12:15:34 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:15:34 user nova-compute[74261]: </disk>
Oct 17 12:15:34 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:15:34 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config.
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:15:34 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:15:34 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:15:34 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:15:34 user nova-compute[74261]:   <serial>419a4e33-d745-45c1-97e7-d93337798970</serial>
Oct 17 12:15:34 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:15:34 user nova-compute[74261]: </disk>
Oct 17 12:15:34 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:15:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:15:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:15:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:15:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:15:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:15:39 user nova-compute[74261]: INFO nova.compute.claims [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Claim successful on node user
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:15:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.policy [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '180638ab7be5488285bb8900a233482c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4461d212c834e488059b733cfa0d7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:15:39 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Creating image(s)
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "/opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "/opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk 1073741824" returned: 0 in 0.057s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Successfully created port: 93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.191s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Cannot resize image /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Successfully updated port: 93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "refresh_cache-b2663732-7236-40b9-ba05-ab9fb17b6fb5" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquired lock "refresh_cache-b2663732-7236-40b9-ba05-ab9fb17b6fb5" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-changed-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Refreshing instance network info cache due to event network-changed-93ea4f26-8953-484b-afc6-4773a68b5983. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] Acquiring lock "refresh_cache-b2663732-7236-40b9-ba05-ab9fb17b6fb5" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Updating instance_info_cache with network_info: [{"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Releasing lock "refresh_cache-b2663732-7236-40b9-ba05-ab9fb17b6fb5" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Instance network_info: |[{"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] Acquired lock "refresh_cache-b2663732-7236-40b9-ba05-ab9fb17b6fb5" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.neutron [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Refreshing network info cache for port 93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Start _get_guest_xml network_info=[{"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:15:41 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:15:41 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2024574521',display_name='tempest-VolumesActionsTest-instance-2024574521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2024574521',id=44,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4461d212c834e488059b733cfa0d7a6',ramdisk_id='',reservation_id='r-odf6dc9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-17699373',owner_user_name='tempest-VolumesActionsTest-17699373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:15:40Z,user_data=None,user_id='180638ab7be5488285bb8900a233482c',uuid=b2663732-7236-40b9-ba05-ab9fb17b6fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converting VIF {"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lazy-loading 'pci_devices' on Instance uuid b2663732-7236-40b9-ba05-ab9fb17b6fb5 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:15:41 user nova-compute[74261]:   <uuid>b2663732-7236-40b9-ba05-ab9fb17b6fb5</uuid>
Oct 17 12:15:41 user nova-compute[74261]:   <name>instance-0000002c</name>
Oct 17 12:15:41 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:15:41 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:15:41 user nova-compute[74261]:   <metadata>
Oct 17 12:15:41 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:15:41 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:15:41 user nova-compute[74261]:       <nova:name>tempest-VolumesActionsTest-instance-2024574521</nova:name>
Oct 17 12:15:41 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:15:41</nova:creationTime>
Oct 17 12:15:41 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:15:41 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:15:41 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:15:41 user nova-compute[74261]:       <nova:owner>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:user uuid="180638ab7be5488285bb8900a233482c">tempest-VolumesActionsTest-17699373-project-member</nova:user>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:project uuid="c4461d212c834e488059b733cfa0d7a6">tempest-VolumesActionsTest-17699373</nova:project>
Oct 17 12:15:41 user nova-compute[74261]:       </nova:owner>
Oct 17 12:15:41 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:15:41 user nova-compute[74261]:       <nova:ports>
Oct 17 12:15:41 user nova-compute[74261]:         <nova:port uuid="93ea4f26-8953-484b-afc6-4773a68b5983">
Oct 17 12:15:41 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 12:15:41 user nova-compute[74261]:         </nova:port>
Oct 17 12:15:41 user nova-compute[74261]:       </nova:ports>
Oct 17 12:15:41 user nova-compute[74261]:     </nova:instance>
Oct 17 12:15:41 user nova-compute[74261]:   </metadata>
Oct 17 12:15:41 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:15:41 user nova-compute[74261]:     <system>
Oct 17 12:15:41 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:15:41 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:15:41 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:15:41 user nova-compute[74261]:       <entry name="serial">b2663732-7236-40b9-ba05-ab9fb17b6fb5</entry>
Oct 17 12:15:41 user nova-compute[74261]:       <entry name="uuid">b2663732-7236-40b9-ba05-ab9fb17b6fb5</entry>
Oct 17 12:15:41 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:15:41 user nova-compute[74261]:     </system>
Oct 17 12:15:41 user nova-compute[74261]:   </sysinfo>
Oct 17 12:15:41 user nova-compute[74261]:   <os>
Oct 17 12:15:41 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:15:41 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:15:41 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:15:41 user nova-compute[74261]:   </os>
Oct 17 12:15:41 user nova-compute[74261]:   <features>
Oct 17 12:15:41 user nova-compute[74261]:     <acpi/>
Oct 17 12:15:41 user nova-compute[74261]:     <apic/>
Oct 17 12:15:41 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:15:41 user nova-compute[74261]:   </features>
Oct 17 12:15:41 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:15:41 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:15:41 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:15:41 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:15:41 user nova-compute[74261]:   </clock>
Oct 17 12:15:41 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:15:41 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:15:41 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:15:41 user nova-compute[74261]:   </cpu>
Oct 17 12:15:41 user nova-compute[74261]:   <devices>
Oct 17 12:15:41 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:15:41 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:15:41 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk"/>
Oct 17 12:15:41 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:15:41 user nova-compute[74261]:     </disk>
Oct 17 12:15:41 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:15:41 user nova-compute[74261]:       <mac address="fa:16:3e:22:52:a2"/>
Oct 17 12:15:41 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:15:41 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:15:41 user nova-compute[74261]:       <target dev="tap93ea4f26-89"/>
Oct 17 12:15:41 user nova-compute[74261]:     </interface>
Oct 17 12:15:41 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:15:41 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/console.log" append="off"/>
Oct 17 12:15:41 user nova-compute[74261]:     </serial>
Oct 17 12:15:41 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:15:41 user nova-compute[74261]:     <video>
Oct 17 12:15:41 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:15:41 user nova-compute[74261]:     </video>
Oct 17 12:15:41 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:15:41 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:15:41 user nova-compute[74261]:     </rng>
Oct 17 12:15:41 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:15:41 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:15:41 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:15:41 user nova-compute[74261]:     </memballoon>
Oct 17 12:15:41 user nova-compute[74261]:   </devices>
Oct 17 12:15:41 user nova-compute[74261]: </domain>
Oct 17 12:15:41 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2024574521',display_name='tempest-VolumesActionsTest-instance-2024574521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2024574521',id=44,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4461d212c834e488059b733cfa0d7a6',ramdisk_id='',reservation_id='r-odf6dc9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-17699373',owner_user_name='tempest-VolumesActionsTest-17699373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:15:40Z,user_data=None,user_id='180638ab7be5488285bb8900a233482c',uuid=b2663732-7236-40b9-ba05-ab9fb17b6fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converting VIF {"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG os_vif [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cd498c3-10b1-5b41-a19c-8d926e3bd5e0', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93ea4f26-89, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93ea4f26-89, col_values=(('qos', UUID('63aa3909-9069-4729-9875-264582482529')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93ea4f26-89, col_values=(('external_ids', {'iface-id': '93ea4f26-8953-484b-afc6-4773a68b5983', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:52:a2', 'vm-uuid': 'b2663732-7236-40b9-ba05-ab9fb17b6fb5'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:41 user nova-compute[74261]: INFO os_vif [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89')
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:15:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] No VIF found with MAC fa:16:3e:22:52:a2, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:15:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Updated VIF entry in instance network info cache for port 93ea4f26-8953-484b-afc6-4773a68b5983. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:15:42 user nova-compute[74261]: DEBUG nova.network.neutron [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Updating instance_info_cache with network_info: [{"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:15:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a268f103-9c2a-4515-b352-2fc9078b6ec8 req-89dce4c4-229c-4e69-804e-6b2794c01137 service nova] Releasing lock "refresh_cache-b2663732-7236-40b9-ba05-ab9fb17b6fb5" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] No waiting events found dispatching network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:15:43 user nova-compute[74261]: WARNING nova.compute.manager [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received unexpected event network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 for instance with vm_state building and task_state spawning.
Oct 17 12:15:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] No waiting events found dispatching network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:15:43 user nova-compute[74261]: WARNING nova.compute.manager [req-dd4c3cb2-7bd6-4229-979a-2cafa56b071b req-1d2da322-bd38-4512-b90f-babd21b43b60 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received unexpected event network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 for instance with vm_state building and task_state spawning.
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:15:45 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Instance spawned successfully.
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:15:45 user nova-compute[74261]: INFO nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 17 12:15:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:15:45 user nova-compute[74261]: INFO nova.compute.manager [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Took 6.05 seconds to build instance.
Oct 17 12:15:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-11cf3a72-a151-486b-8a34-3887132a8e5c tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.151s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 is timed out.
Oct 17 12:15:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config.
Oct 17 12:15:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJKlCVOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:15:54 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0ec63-84ad-4d63-aab4-0074cf9a8a24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:15:54 user nova-compute[74261]: No targets found.
Oct 17 12:15:54 user nova-compute[74261]: iSNS:
Oct 17 12:15:54 user nova-compute[74261]: No targets found.
Oct 17 12:15:54 user nova-compute[74261]: STATIC:
Oct 17 12:15:54 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970
Oct 17 12:15:54 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:15:54 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:15:54 user nova-compute[74261]: FIRMWARE:
Oct 17 12:15:54 user nova-compute[74261]: No targets found.
Oct 17 12:15:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:15:54 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:15:54 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95d81e4-cc3f-4748-82dc-c3e567f0fe71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af3e3e-8d89-4c5b-9791-5537b2d91d01]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 (non-flash)
Oct 17 12:15:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 (non-flash)
Oct 17 12:15:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae8650f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b41dfe9-2bc3-4f0c-bc48-95b0fe6c0a22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac4ea2a-8de3-477c-84d8-c0719f25deda]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b6e1a-52b8-4473-8269-7a2486276ce6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[249dfb08-6530-478a-af97-7fa8dff3d663]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a72b8c-f5d1-4042-b847-2d776c79f39f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b69f84-b1d9-428a-806b-e207f4d5a450]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260]
Oct 17 12:15:54 user nova-compute[74261]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970, portal: 172.16.0.220,3260] successful.
Oct 17 12:15:54 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419a4e33-d745-45c1-97e7-d93337798970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d96a123-6f79-4c5e-b470-df58a909651d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== disconnect_volume: return (288ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:15:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:15:55 user nova-compute[74261]: DEBUG nova.objects.instance [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:15:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-49d3a164-f432-4468-b601-cca1fe579642 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.571s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:15:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:15:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:15:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:15:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:15:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:15:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:16:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-changed-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.compute.manager [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Refreshing instance network info cache due to event network-changed-23a5af7b-470f-4066-bfcc-8449889703e8. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] Acquiring lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] Acquired lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Refreshing network info cache for port 23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.objects.instance [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'flavor' on Instance uuid 7ed9302f-114d-4ddf-a151-6d6f2999976e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:16:24 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Ignoring supplied device name: /dev/vdb
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:24 user nova-compute[74261]: INFO nova.compute.manager [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Attaching volume 58561b01-b8f4-4bac-aacd-13f80a910080 to /dev/vdb
Oct 17 12:16:24 user nova-compute[74261]: DEBUG os_brick.utils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ca939-eea2-401c-80d5-8bda468f1d5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[28326b98-91f1-42fa-a5ed-d3092a030a2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac30be2-4089-47e9-b002-17ff83b35c54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031419f-168d-4b4c-9990-348bf7799e18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updated VIF entry in instance network info cache for port 23a5af7b-470f-4066-bfcc-8449889703e8. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.network.neutron [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updating instance_info_cache with network_info: [{"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02c9ad77-20ff-4341-bb48-caa45ff4fd64 req-f4e81490-8581-4c67-b483-d8be2b3db1d8 service nova] Releasing lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:16:24 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[53004fbe-801f-43e6-a868-c9de7d515c08]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG os_brick.utils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updating existing volume attachment record: f3d23f31-bff8-4542-9703-e6e2a233e5ac {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:16:24 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:26 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:16:26 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=25.163280487060547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7ed9302f-114d-4ddf-a151-6d6f2999976e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance b2663732-7236-40b9-ba05-ab9fb17b6fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:16:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:29 user nova-compute[74261]: INFO nova.compute.manager [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attaching volume 4dfd304d-8964-4088-ad69-226df2f52754 to /dev/vdb
Oct 17 12:16:29 user nova-compute[74261]: DEBUG os_brick.utils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0667bf04-3759-4e85-bf1c-fffe0556e525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9edfb6-9f5a-4ccc-8ccd-594bbe9c359e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca91de5-f8c5-4b97-a819-6fb71a8f24a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4568a4-9f33-431b-88b7-613e3da553be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:16:29 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:16:29 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09d53d-b600-45ea-b804-6f7437d4c36a]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG os_brick.utils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:16:29 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating existing volume attachment record: 658558f3-4e6b-4f50-8be8-c3d43ef732d3 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updating instance_info_cache with network_info: [{"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7ed9302f-114d-4ddf-a151-6d6f2999976e" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:16:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWypUJOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:16:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:16:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:16:40 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f3ba84-68f2-41c3-85ae-e3bd93497472]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:16:40 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e42ecc-c14d-466c-bd49-7c17accd1c53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080] added
Oct 17 12:16:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[990fda9b-d494-485c-9bff-133749c35c10]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09c1131-4c45-4e3f-aba4-dd25d2d47008]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWypUJOE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWypUJOE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[65331576-5016-4b69-9ee9-325de0848700]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWypUJOE'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[203ca66c-9b58-4fdf-9eb4-6278d312e1d6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[83abdb6f-1d14-4230-93ef-793fca7d4d5c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:16:41 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:16:41 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:16:41 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:16:41 user nova-compute[74261]: 
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b004a546-d918-4419-922f-3ca95db3be51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260]
Oct 17 12:16:41 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260] successful.
Oct 17 12:16:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf0169-5cb8-47bc-b648-6eb0327fd0a1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d15d361-0b1c-4b65-9214-524224d800a8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:16:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:16:41 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc085d71-d6cc-433c-b24e-c0628c89c441]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWypUJOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23966326364306538', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966326364306538', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'flavor' on Instance uuid 7ed9302f-114d-4ddf-a151-6d6f2999976e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:16:42 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:16:42 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:16:42 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:16:42 user nova-compute[74261]:   <serial>58561b01-b8f4-4bac-aacd-13f80a910080</serial>
Oct 17 12:16:42 user nova-compute[74261]: </disk>
Oct 17 12:16:42 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] No VIF found with MAC fa:16:3e:f6:01:6e, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:16:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-77d5c61e-745e-4243-81b1-c646ebc68edf tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUwiHTvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:16:45 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:16:45 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:16:45 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed065795-ab00-4706-bff8-b79d1f8c9b18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:16:45 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c4702-ecd5-4fc0-b5b9-239cbcb09fab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754] added
Oct 17 12:16:45 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2de68-bf28-46e4-bcc3-1020bba05603]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[132ca1db-5b63-4083-83b8-87755282989e]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUwiHTvC {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUwiHTvC" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be80568-ce54-449a-9166-d731f5a6b2a0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUwiHTvC'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5fc38a-140d-48f6-9866-3c05852725c2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[036bb957-fc86-4154-9865-85e5b2b71c16]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:16:45 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:16:45 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba3727-f3d0-4dce-b6d7-c318901c8e61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260]
Oct 17 12:16:45 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260] successful.
Oct 17 12:16:45 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0553a7-78e7-42b9-bc86-74abccc0db96]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c742f2-92b2-495d-abca-1c48b9f6b334]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:16:45 user nova-compute[74261]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 (non-flash)
Oct 17 12:16:45 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:16:45 user nova-compute[74261]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 (non-flash)
Oct 17 12:16:45 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ddef0-b347-48c8-8126-3c03b6835b62]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:16:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUwiHTvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:16:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:16:46 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23736383432663634', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:16:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736383432663634', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:16:46 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:16:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:16:46 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:16:46 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:16:46 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:16:46 user nova-compute[74261]:   <serial>4dfd304d-8964-4088-ad69-226df2f52754</serial>
Oct 17 12:16:46 user nova-compute[74261]: </disk>
Oct 17 12:16:46 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:16:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:16:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:16:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No VIF found with MAC fa:16:3e:31:38:cf, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:16:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d9ec2226-3093-431e-89b4-d7466f39f9dd tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.980s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:16:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:16:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:16:49 user nova-compute[74261]: INFO nova.compute.manager [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Detaching volume 4dfd304d-8964-4088-ad69-226df2f52754
Oct 17 12:16:49 user nova-compute[74261]: INFO nova.virt.block_device [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attempting to driver detach volume 4dfd304d-8964-4088-ad69-226df2f52754 from mountpoint /dev/vdb
Oct 17 12:16:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Attempting to detach device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:16:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:16:49 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:16:49 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:16:49 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:16:49 user nova-compute[74261]:   <serial>4dfd304d-8964-4088-ad69-226df2f52754</serial>
Oct 17 12:16:49 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:16:49 user nova-compute[74261]: </disk>
Oct 17 12:16:49 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:16:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config.
Oct 17 12:16:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:16:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:16:49 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:16:49 user nova-compute[74261]:   <source dev="/dev/sdc"/>
Oct 17 12:16:49 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:16:49 user nova-compute[74261]:   <serial>4dfd304d-8964-4088-ad69-226df2f52754</serial>
Oct 17 12:16:49 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:16:49 user nova-compute[74261]: </disk>
Oct 17 12:16:49 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:16:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:16:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:17:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:17:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:17:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:09 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 is timed out.
Oct 17 12:17:09 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config.
Oct 17 12:17:09 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:17:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUwiHTvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:17:09 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:17:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:17:09 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:17:09 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0b2a2-419f-4061-9615-752dab14c903]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:17:10 user nova-compute[74261]: No targets found.
Oct 17 12:17:10 user nova-compute[74261]: iSNS:
Oct 17 12:17:10 user nova-compute[74261]: No targets found.
Oct 17 12:17:10 user nova-compute[74261]: STATIC:
Oct 17 12:17:10 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754
Oct 17 12:17:10 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:17:10 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:17:10 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080
Oct 17 12:17:10 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:17:10 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:17:10 user nova-compute[74261]: FIRMWARE:
Oct 17 12:17:10 user nova-compute[74261]: No targets found.
Oct 17 12:17:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:17:10 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:17:10 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7f1287-fb76-4501-9b4c-6a081b3d49ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6783066-bf77-4da3-9862-4f5399dfb816]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:17:10 user nova-compute[74261]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 (non-flash)
Oct 17 12:17:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:17:10 user nova-compute[74261]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 (non-flash)
Oct 17 12:17:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2f5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[762919d9-d5f8-4da0-a55c-5a6c1483009a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd92a0-b296-4f5a-bba3-63088db08e02]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2bc41-a579-4d29-a483-9b3f907fbd6c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7df5dc7-b535-4ad9-bff2-90e875629c17]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad671ad4-4fc9-4f4e-b15b-9087f5c215be]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c157f6ca-9d80-4e9c-b274-6169d56a9a86]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260]
Oct 17 12:17:10 user nova-compute[74261]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754, portal: 172.16.0.220,3260] successful.
Oct 17 12:17:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd304d-8964-4088-ad69-226df2f52754 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[81be1283-73ae-4d88-9ccd-dfb465738a93]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== disconnect_volume: return (287ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:17:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:17:11 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:17:11 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e8826beb-9320-47f3-a344-fb47ea12dbce tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:17:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:17:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:17:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:26 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:17:26 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:17:26 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.16156005859375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:27 user nova-compute[74261]: INFO nova.compute.manager [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Detaching volume 58561b01-b8f4-4bac-aacd-13f80a910080
Oct 17 12:17:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7ed9302f-114d-4ddf-a151-6d6f2999976e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance b2663732-7236-40b9-ba05-ab9fb17b6fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:17:27 user nova-compute[74261]: INFO nova.virt.block_device [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Attempting to driver detach volume 58561b01-b8f4-4bac-aacd-13f80a910080 from mountpoint /dev/vdb
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Attempting to detach device vdb from instance 7ed9302f-114d-4ddf-a151-6d6f2999976e from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:17:27 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:17:27 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:17:27 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:17:27 user nova-compute[74261]:   <serial>58561b01-b8f4-4bac-aacd-13f80a910080</serial>
Oct 17 12:17:27 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:17:27 user nova-compute[74261]: </disk>
Oct 17 12:17:27 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:17:27 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully detached device vdb from instance 7ed9302f-114d-4ddf-a151-6d6f2999976e from the persistent domain config.
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ed9302f-114d-4ddf-a151-6d6f2999976e from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:17:27 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:17:27 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:17:27 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:17:27 user nova-compute[74261]:   <serial>58561b01-b8f4-4bac-aacd-13f80a910080</serial>
Oct 17 12:17:27 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:17:27 user nova-compute[74261]: </disk>
Oct 17 12:17:27 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ed9302f-114d-4ddf-a151-6d6f2999976e {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:17:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:17:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:29 user nova-compute[74261]: INFO nova.compute.manager [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Terminating instance
Oct 17 12:17:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a85a0a9-c1cb-419d-9803-08d539cf498a req-9f4f768b-0266-43d8-9ee5-eeef7746e631 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-vif-unplugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a85a0a9-c1cb-419d-9803-08d539cf498a req-9f4f768b-0266-43d8-9ee5-eeef7746e631 service nova] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a85a0a9-c1cb-419d-9803-08d539cf498a req-9f4f768b-0266-43d8-9ee5-eeef7746e631 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a85a0a9-c1cb-419d-9803-08d539cf498a req-9f4f768b-0266-43d8-9ee5-eeef7746e631 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a85a0a9-c1cb-419d-9803-08d539cf498a req-9f4f768b-0266-43d8-9ee5-eeef7746e631 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] No waiting events found dispatching network-vif-unplugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a85a0a9-c1cb-419d-9803-08d539cf498a req-9f4f768b-0266-43d8-9ee5-eeef7746e631 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-vif-unplugged-93ea4f26-8953-484b-afc6-4773a68b5983 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Instance destroyed successfully.
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.objects.instance [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lazy-loading 'resources' on Instance uuid b2663732-7236-40b9-ba05-ab9fb17b6fb5 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2024574521',display_name='tempest-VolumesActionsTest-instance-2024574521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2024574521',id=44,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4461d212c834e488059b733cfa0d7a6',ramdisk_id='',reservation_id='r-odf6dc9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-17699373',owner_user_name='tempest-VolumesActionsTest-17699373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:15:45Z,user_data=None,user_id='180638ab7be5488285bb8900a233482c',uuid=b2663732-7236-40b9-ba05-ab9fb17b6fb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converting VIF {"id": "93ea4f26-8953-484b-afc6-4773a68b5983", "address": "fa:16:3e:22:52:a2", "network": {"id": "492f37dc-c568-4e6c-b5e1-17a2481cabbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-384709392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4461d212c834e488059b733cfa0d7a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ea4f26-89", "ovs_interfaceid": "93ea4f26-8953-484b-afc6-4773a68b5983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG os_vif [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93ea4f26-89, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63aa3909-9069-4729-9875-264582482529) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:30 user nova-compute[74261]: INFO os_vif [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=93ea4f26-8953-484b-afc6-4773a68b5983,network=Network(492f37dc-c568-4e6c-b5e1-17a2481cabbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ea4f26-89')
Oct 17 12:17:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Deleting instance files /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5_del
Oct 17 12:17:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Deletion of /opt/stack/data/nova/instances/b2663732-7236-40b9-ba05-ab9fb17b6fb5_del complete
Oct 17 12:17:30 user nova-compute[74261]: INFO nova.compute.manager [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Took 0.64 seconds to destroy the instance on the hypervisor.
Oct 17 12:17:30 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:17:30 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:17:31 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:17:31 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Took 0.63 seconds to deallocate network for instance.
Oct 17 12:17:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:17:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:17:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:31 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:31 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Deleted allocations for instance b2663732-7236-40b9-ba05-ab9fb17b6fb5
Oct 17 12:17:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-cfddbcc0-3f5d-49fb-8c9e-3d4324d84ea4 tempest-VolumesActionsTest-17699373 tempest-VolumesActionsTest-17699373-project-member] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.673s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] Acquiring lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] Lock "b2663732-7236-40b9-ba05-ab9fb17b6fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] No waiting events found dispatching network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:17:32 user nova-compute[74261]: WARNING nova.compute.manager [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received unexpected event network-vif-plugged-93ea4f26-8953-484b-afc6-4773a68b5983 for instance with vm_state deleted and task_state None.
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [req-682c1a5e-2203-4024-b1d9-db763597ddfd req-dc8555aa-a93b-441e-95b1-386ee9fba9c3 service nova] [instance: b2663732-7236-40b9-ba05-ab9fb17b6fb5] Received event network-vif-deleted-93ea4f26-8953-484b-afc6-4773a68b5983 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Skipping network cache update for instance because it is being deleted. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:17:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:17:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG nova.objects.instance [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:44 user nova-compute[74261]: INFO nova.compute.manager [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attaching volume 328c380c-8a9d-42e6-ba17-296d8ebefa44 to /dev/vdb
Oct 17 12:17:44 user nova-compute[74261]: DEBUG os_brick.utils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e2243-8e71-4390-b8cd-1ff9e33f5a52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2920aa49-6646-4558-852a-b3d60f6bb25f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1df15-bdba-4f5a-bb16-422e51c586ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938e6b0-b41f-4384-b8fc-fdb3a3ac934d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:17:44 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:17:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[76341e47-0236-4992-b609-fc1e3a89dd70]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG os_brick.utils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:17:44 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating existing volume attachment record: a18d2aec-0a31-4076-85be-1426122e169d {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:17:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:47 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ed9302f-114d-4ddf-a151-6d6f2999976e is timed out.
Oct 17 12:17:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully detached device vdb from instance 7ed9302f-114d-4ddf-a151-6d6f2999976e from the live domain config.
Oct 17 12:17:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWypUJOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:17:47 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1b6d4-6713-442a-a08e-587ca8815d29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:17:47 user nova-compute[74261]: No targets found.
Oct 17 12:17:47 user nova-compute[74261]: iSNS:
Oct 17 12:17:47 user nova-compute[74261]: No targets found.
Oct 17 12:17:47 user nova-compute[74261]: STATIC:
Oct 17 12:17:47 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080
Oct 17 12:17:47 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:17:47 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:17:47 user nova-compute[74261]: FIRMWARE:
Oct 17 12:17:47 user nova-compute[74261]: No targets found.
Oct 17 12:17:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:17:47 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:17:47 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa23471c-dc2e-495c-b44e-c337dbe47c26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d14101d-de6a-4be0-9385-3a4f8d736926]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:17:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 (non-flash)
Oct 17 12:17:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae8652050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c394142-6441-49d4-8d25-bb2ec52d5573]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[96123986-6fc6-4761-9a9d-d07baa3c3e81]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c7acd2-e404-43a2-82fd-c7f69be2adb0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f773a7-160b-4ffa-b146-ffa861d55d10]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3713851-eff6-46ed-a152-3d82e76551cb]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[287a0df2-9cea-4de4-9895-1daeb588f6c9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260]
Oct 17 12:17:47 user nova-compute[74261]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080, portal: 172.16.0.220,3260] successful.
Oct 17 12:17:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f586d7-eda9-49af-b2dd-457452edc250]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== disconnect_volume: return (291ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:17:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'flavor' on Instance uuid 7ed9302f-114d-4ddf-a151-6d6f2999976e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-b539e3f0-9f26-4f7b-8ce7-2997fe090c5c tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.619s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:48 user nova-compute[74261]: INFO nova.compute.manager [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Terminating instance
Oct 17 12:17:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-b876323d-800c-41d5-82d6-8c079a9249c4 req-f1636be4-bfce-4271-8edc-ce0c60b46a6e service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-vif-unplugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b876323d-800c-41d5-82d6-8c079a9249c4 req-f1636be4-bfce-4271-8edc-ce0c60b46a6e service nova] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b876323d-800c-41d5-82d6-8c079a9249c4 req-f1636be4-bfce-4271-8edc-ce0c60b46a6e service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b876323d-800c-41d5-82d6-8c079a9249c4 req-f1636be4-bfce-4271-8edc-ce0c60b46a6e service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-b876323d-800c-41d5-82d6-8c079a9249c4 req-f1636be4-bfce-4271-8edc-ce0c60b46a6e service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] No waiting events found dispatching network-vif-unplugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:17:48 user nova-compute[74261]: DEBUG nova.compute.manager [req-b876323d-800c-41d5-82d6-8c079a9249c4 req-f1636be4-bfce-4271-8edc-ce0c60b46a6e service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-vif-unplugged-23a5af7b-470f-4066-bfcc-8449889703e8 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:17:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Instance destroyed successfully.
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lazy-loading 'resources' on Instance uuid 7ed9302f-114d-4ddf-a151-6d6f2999976e {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1839609459',display_name='tempest-VolumesSnapshotTestJSON-instance-1839609459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1839609459',id=43,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES4O7YFt9LVQAhLdQ1xUbSYeCR654mNYxF3J+1axuBoIclEzFW5908GkDYqBkwDQ8w6n8GEapooRR39Gv2IQbV/Wk8tunrZFBMT5kHFeIPJ2GHiye2CP9HiTCoLMwbjzg==',key_name='tempest-keypair-1483979433',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:14:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d347c39d44761af3558abf37f7822',ramdisk_id='',reservation_id='r-g81wdhq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1072624135',owner_user_name='tempest-VolumesSnapshotTestJSON-1072624135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539289bce741475693adef12bd561c95',uuid=7ed9302f-114d-4ddf-a151-6d6f2999976e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converting VIF {"id": "23a5af7b-470f-4066-bfcc-8449889703e8", "address": "fa:16:3e:f6:01:6e", "network": {"id": "fc0e6970-a1e1-43db-bd70-285b2213250c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-993062467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d347c39d44761af3558abf37f7822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a5af7b-47", "ovs_interfaceid": "23a5af7b-470f-4066-bfcc-8449889703e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_vif [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23a5af7b-47, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7eec02d-137b-4572-8899-b01830f3908b) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:49 user nova-compute[74261]: INFO os_vif [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:01:6e,bridge_name='br-int',has_traffic_filtering=True,id=23a5af7b-470f-4066-bfcc-8449889703e8,network=Network(fc0e6970-a1e1-43db-bd70-285b2213250c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a5af7b-47')
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:58561b01-b8f4-4bac-aacd-13f80a910080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWypUJOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:17:49 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7154d7bc-49c6-44d7-adbb-960d13358ad4]: Unexpected error while running command.
Oct 17 12:17:49 user nova-compute[74261]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 17 12:17:49 user nova-compute[74261]: Exit code: 21
Oct 17 12:17:49 user nova-compute[74261]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 17 12:17:49 user nova-compute[74261]: Stderr: '' {{(pid=86003) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 17 12:17:49 user nova-compute[74261]: Traceback (most recent call last):
Oct 17 12:17:49 user nova-compute[74261]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 17 12:17:49 user nova-compute[74261]:     ret = func(*f_args, **f_kwargs)
Oct 17 12:17:49 user nova-compute[74261]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 17 12:17:49 user nova-compute[74261]:     return func(*args, **kwargs)
Oct 17 12:17:49 user nova-compute[74261]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 17 12:17:49 user nova-compute[74261]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 17 12:17:49 user nova-compute[74261]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 17 12:17:49 user nova-compute[74261]:     return putils.execute(on_execute=on_execute,
Oct 17 12:17:49 user nova-compute[74261]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 17 12:17:49 user nova-compute[74261]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 17 12:17:49 user nova-compute[74261]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 17 12:17:49 user nova-compute[74261]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 17 12:17:49 user nova-compute[74261]: Exit code: 21
Oct 17 12:17:49 user nova-compute[74261]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 17 12:17:49 user nova-compute[74261]: Stderr: ''
Oct 17 12:17:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7154d7bc-49c6-44d7-adbb-960d13358ad4]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 17 12:17:49 user nova-compute[74261]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 17 12:17:49 user nova-compute[74261]: Exit code: 21
Oct 17 12:17:49 user nova-compute[74261]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 17 12:17:49 user nova-compute[74261]: Stderr: ''
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 17 12:17:49 user nova-compute[74261]: ERROR os_brick.initiator.connectors.iscsi 
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74261) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] <== disconnect_volume: return (38ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:17:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Deleting instance files /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e_del
Oct 17 12:17:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Deletion of /opt/stack/data/nova/instances/7ed9302f-114d-4ddf-a151-6d6f2999976e_del complete
Oct 17 12:17:49 user nova-compute[74261]: INFO nova.compute.manager [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 17 12:17:49 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:17:49 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:17:50 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Took 1.21 seconds to deallocate network for instance.
Oct 17 12:17:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-37301058-cb8a-41e5-9177-75f5887aab60 req-7d16ed08-ed54-4591-bbdf-54c6af66d728 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-vif-deleted-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:17:50 user nova-compute[74261]: WARNING nova.volume.cinder [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Attachment f3d23f31-bff8-4542-9703-e6e2a233e5ac does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f3d23f31-bff8-4542-9703-e6e2a233e5ac. (HTTP 404) (Request-ID: req-a035caec-dd65-41a7-8698-e37be22162ff)
Oct 17 12:17:50 user nova-compute[74261]: INFO nova.compute.manager [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Took 0.03 seconds to detach 1 volumes for instance.
Oct 17 12:17:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-5bbd64fb-125d-4dda-bcc4-19f508082dec req-46825326-1244-40db-aba7-f858de68f286 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received event network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5bbd64fb-125d-4dda-bcc4-19f508082dec req-46825326-1244-40db-aba7-f858de68f286 service nova] Acquiring lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5bbd64fb-125d-4dda-bcc4-19f508082dec req-46825326-1244-40db-aba7-f858de68f286 service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5bbd64fb-125d-4dda-bcc4-19f508082dec req-46825326-1244-40db-aba7-f858de68f286 service nova] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-5bbd64fb-125d-4dda-bcc4-19f508082dec req-46825326-1244-40db-aba7-f858de68f286 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] No waiting events found dispatching network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:17:50 user nova-compute[74261]: WARNING nova.compute.manager [req-5bbd64fb-125d-4dda-bcc4-19f508082dec req-46825326-1244-40db-aba7-f858de68f286 service nova] [instance: 7ed9302f-114d-4ddf-a151-6d6f2999976e] Received unexpected event network-vif-plugged-23a5af7b-470f-4066-bfcc-8449889703e8 for instance with vm_state deleted and task_state None.
Oct 17 12:17:51 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:17:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:17:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:51 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Deleted allocations for instance 7ed9302f-114d-4ddf-a151-6d6f2999976e
Oct 17 12:17:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d5f03f05-47ed-4fdd-ac63-289fd3e879eb tempest-VolumesSnapshotTestJSON-1072624135 tempest-VolumesSnapshotTestJSON-1072624135-project-member] Lock "7ed9302f-114d-4ddf-a151-6d6f2999976e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:17:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:17:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:17:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:17:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:17:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:17:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfCGKLNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:18:00 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:18:00 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:18:00 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[88148eb8-9e9d-457c-a386-1ad378a3c8a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:18:00 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a758528-5f79-49cb-90d2-b9d7de69a348]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44] added
Oct 17 12:18:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db5c8d1-21c6-4fad-b625-20fb19c88f67]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea563e0-cf81-4a62-ae07-00113bb9a413]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfCGKLNH {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfCGKLNH" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c3a92b-e83a-4251-bf8c-0d87687c07cb]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gfCGKLNH'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a089395-2841-4b4e-8719-92221848e644]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[272749c9-e8e1-4962-b3ab-96db769920d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:18:00 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:18:00 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:18:00 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:18:00 user nova-compute[74261]: 
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9527f1d-9260-4187-8278-2a56f6b8f99a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260]
Oct 17 12:18:00 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260] successful.
Oct 17 12:18:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e755c40-a6ac-47e9-8ff7-4f6fceeda224]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc4b9bd-9ba8-42f9-945c-e246a31c6d7c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 (non-flash)
Oct 17 12:18:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 (non-flash)
Oct 17 12:18:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d07192e-a324-40c8-b073-9ddfd42faf3b]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:18:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfCGKLNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:18:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:18:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26566643837303134', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:18:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566643837303134', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:18:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:18:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:18:01 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:18:01 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:18:01 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:18:01 user nova-compute[74261]:   <serial>328c380c-8a9d-42e6-ba17-296d8ebefa44</serial>
Oct 17 12:18:01 user nova-compute[74261]: </disk>
Oct 17 12:18:01 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:18:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:18:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:18:02 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] No VIF found with MAC fa:16:3e:31:38:cf, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:18:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5b7df699-f5ec-4668-8086-027726144743 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.665s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:18:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:18:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:18:04 user nova-compute[74261]: INFO nova.compute.manager [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Detaching volume 328c380c-8a9d-42e6-ba17-296d8ebefa44
Oct 17 12:18:04 user nova-compute[74261]: INFO nova.virt.block_device [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Attempting to driver detach volume 328c380c-8a9d-42e6-ba17-296d8ebefa44 from mountpoint /dev/vdb
Oct 17 12:18:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Attempting to detach device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:18:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:18:04 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:18:04 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:18:04 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:18:04 user nova-compute[74261]:   <serial>328c380c-8a9d-42e6-ba17-296d8ebefa44</serial>
Oct 17 12:18:04 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:18:04 user nova-compute[74261]: </disk>
Oct 17 12:18:04 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:18:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the persistent domain config.
Oct 17 12:18:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:18:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:18:04 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:18:04 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:18:04 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:18:04 user nova-compute[74261]:   <serial>328c380c-8a9d-42e6-ba17-296d8ebefa44</serial>
Oct 17 12:18:04 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:18:04 user nova-compute[74261]: </disk>
Oct 17 12:18:04 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:18:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:18:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:17 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:25 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80f5ad0c-0558-477a-8319-87f995e4e065 is timed out.
Oct 17 12:18:25 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully detached device vdb from instance 80f5ad0c-0558-477a-8319-87f995e4e065 from the live domain config.
Oct 17 12:18:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfCGKLNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:18:25 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ae202-02e1-4171-9d52-b3b3f764f1ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:18:25 user nova-compute[74261]: No targets found.
Oct 17 12:18:25 user nova-compute[74261]: iSNS:
Oct 17 12:18:25 user nova-compute[74261]: No targets found.
Oct 17 12:18:25 user nova-compute[74261]: STATIC:
Oct 17 12:18:25 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44
Oct 17 12:18:25 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:18:25 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:18:25 user nova-compute[74261]: FIRMWARE:
Oct 17 12:18:25 user nova-compute[74261]: No targets found.
Oct 17 12:18:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:18:25 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:18:25 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eff6291-d228-4b44-8819-01bb2286459f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d4d7f-aa5e-4f8d-9504-80c6d9157bb8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 (non-flash)
Oct 17 12:18:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 (non-flash)
Oct 17 12:18:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2ba9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3603fd-e535-4130-9fd9-8b8d533b0cae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4335b8-3064-4a9c-ba0f-4adfe5c02381]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c36e48c-f792-4412-a048-a0d07d437c57]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7506ccc-f1b6-4d54-a7eb-647013531d54]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a315d8cb-d10f-4c24-8ea6-12c06d55f3ac]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f73c3c4-2352-4704-85dc-03452ba7fd6f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260]
Oct 17 12:18:25 user nova-compute[74261]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44, portal: 172.16.0.220,3260] successful.
Oct 17 12:18:25 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328c380c-8a9d-42e6-ba17-296d8ebefa44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08e03b-f1a4-4de9-9215-a35348f5af74]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] <== disconnect_volume: return (266ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:18:25 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:18:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:18:26 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'flavor' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:18:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c08d614f-1986-49dd-9555-3516cdcec6e9 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:18:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:18:28 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:18:28 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=25.215343475341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:18:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:18:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:33 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:18:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:18:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:18:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:18:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:18:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:18:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:18:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:18:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:18:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:19:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:19:28 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:19:28 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.213241577148438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:19:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:19:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:33 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:19:34 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:19:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [{"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:19:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-80f5ad0c-0558-477a-8319-87f995e4e065" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:19:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:19:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:19:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Verify base images {{(pid=74261) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Image id 2b60d4df-2b06-4b78-b4ef-1c17d613f5c0 yields fingerprint 892818900e050e9c3a61d090e85bf5aaa79a6a4c {{(pid=74261) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] image 2b60d4df-2b06-4b78-b4ef-1c17d613f5c0 at (/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c): checking
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] image 2b60d4df-2b06-4b78-b4ef-1c17d613f5c0 at (/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c): image is in use {{(pid=74261) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74261) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] 80f5ad0c-0558-477a-8319-87f995e4e065 is a valid instance name {{(pid=74261) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] 80f5ad0c-0558-477a-8319-87f995e4e065 has a disk file {{(pid=74261) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 is backed by 892818900e050e9c3a61d090e85bf5aaa79a6a4c {{(pid=74261) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0
Oct 17 12:19:50 user nova-compute[74261]: WARNING nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Unknown base file: /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Active base files: /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Removable base files: /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336 /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975 /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5 /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0 /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e45af1f64a6453ee475d527f2e37b772b9a793ed
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e129d60bdda9f5280c694a198f2bd2c1d1d40336
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ffa8d256515a8a56eaf5b427a22a21372737a975
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/259e529f78ae674b8816466a0c3ef6ff7379949c
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f0191766899d5c50582a27b4e510bb28108d791f
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/72a591a9c59aeb070caeece67ca6e9b74116ebc5
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9689639cd8a87c316d9297886b63bcef90802b0
Oct 17 12:19:50 user nova-compute[74261]: INFO nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/baf3d35763a94bc934276af68c45cd28cb94378f
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Verification complete {{(pid=74261) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Verify swap images {{(pid=74261) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 17 12:19:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.imagecache [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Verify ephemeral images {{(pid=74261) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 17 12:19:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:19:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:20:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:20:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:19 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:20:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:28 user nova-compute[74261]: INFO nova.compute.manager [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Terminating instance
Oct 17 12:20:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:20:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-25605b11-5908-42fc-a349-acd964c0ce65 req-e76da4c0-e2fc-448d-b7b5-78f531c4c3f5 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-vif-unplugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25605b11-5908-42fc-a349-acd964c0ce65 req-e76da4c0-e2fc-448d-b7b5-78f531c4c3f5 service nova] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25605b11-5908-42fc-a349-acd964c0ce65 req-e76da4c0-e2fc-448d-b7b5-78f531c4c3f5 service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25605b11-5908-42fc-a349-acd964c0ce65 req-e76da4c0-e2fc-448d-b7b5-78f531c4c3f5 service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-25605b11-5908-42fc-a349-acd964c0ce65 req-e76da4c0-e2fc-448d-b7b5-78f531c4c3f5 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] No waiting events found dispatching network-vif-unplugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.compute.manager [req-25605b11-5908-42fc-a349-acd964c0ce65 req-e76da4c0-e2fc-448d-b7b5-78f531c4c3f5 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-vif-unplugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Instance destroyed successfully.
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.objects.instance [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lazy-loading 'resources' on Instance uuid 80f5ad0c-0558-477a-8319-87f995e4e065 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1490488529',display_name='tempest-SnapshotDataIntegrityTests-server-1490488529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1490488529',id=41,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9/EsZL8DY424CE/TlMnwMql/aB1kVG2pm+DHuoZsNj8N3gMqL1flc4mojK40a6pGgx7r9rsw5ffJhTOArmaiNZqjAsStEBq4czg+uQbXbc+TnjyRXhz+ZVhFQ/rtEEfg==',key_name='tempest-keypair-1921630278',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e9069e5b23c49358fdc9c631ad029c4',ramdisk_id='',reservation_id='r-03f4kt6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-217820142',owner_user_name='tempest-SnapshotDataIntegrityTests-217820142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='405c17e59c6b4269aa9c6614e528e3b0',uuid=80f5ad0c-0558-477a-8319-87f995e4e065,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Converting VIF {"id": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "address": "fa:16:3e:31:38:cf", "network": {"id": "832b963e-76b0-4c30-ae58-f45626e98661", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-320884032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e9069e5b23c49358fdc9c631ad029c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec6c362-b6", "ovs_interfaceid": "6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG os_vif [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ec6c362-b6, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05402aae-a5d0-4c46-9290-0d8ad26cdba0) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:20:29 user nova-compute[74261]: INFO os_vif [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:cf,bridge_name='br-int',has_traffic_filtering=True,id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc,network=Network(832b963e-76b0-4c30-ae58-f45626e98661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec6c362-b6')
Oct 17 12:20:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Deleting instance files /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065_del
Oct 17 12:20:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Deletion of /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065_del complete
Oct 17 12:20:29 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000029, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/80f5ad0c-0558-477a-8319-87f995e4e065/disk
Oct 17 12:20:30 user nova-compute[74261]: INFO nova.compute.manager [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 17 12:20:30 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:20:30 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:20:30 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.211650848388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 80f5ad0c-0558-477a-8319-87f995e4e065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:30 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:20:30 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Took 0.90 seconds to deallocate network for instance.
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-c342bf96-727a-4152-8371-58bbf0d8306e req-8dc20179-64e0-4748-9609-f89029c3c151 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-vif-deleted-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:20:31 user nova-compute[74261]: INFO nova.compute.manager [req-c342bf96-727a-4152-8371-58bbf0d8306e req-8dc20179-64e0-4748-9609-f89029c3c151 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Neutron deleted interface 6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc; detaching it from the instance and deleting it from the info cache
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.network.neutron [req-c342bf96-727a-4152-8371-58bbf0d8306e req-8dc20179-64e0-4748-9609-f89029c3c151 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-c342bf96-727a-4152-8371-58bbf0d8306e req-8dc20179-64e0-4748-9609-f89029c3c151 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Detach interface failed, port_id=6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc, reason: Instance 80f5ad0c-0558-477a-8319-87f995e4e065 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:31 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Deleted allocations for instance 80f5ad0c-0558-477a-8319-87f995e4e065
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-96414c80-f8b2-4ce7-a609-be678aee0394 tempest-SnapshotDataIntegrityTests-217820142 tempest-SnapshotDataIntegrityTests-217820142-project-member] Lock "80f5ad0c-0558-477a-8319-87f995e4e065" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.455s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-5a126276-3616-41c2-a179-1200e4e0b0b5 req-71702568-d20f-429b-a57d-06c1d27aa5a0 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received event network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5a126276-3616-41c2-a179-1200e4e0b0b5 req-71702568-d20f-429b-a57d-06c1d27aa5a0 service nova] Acquiring lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5a126276-3616-41c2-a179-1200e4e0b0b5 req-71702568-d20f-429b-a57d-06c1d27aa5a0 service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-5a126276-3616-41c2-a179-1200e4e0b0b5 req-71702568-d20f-429b-a57d-06c1d27aa5a0 service nova] Lock "80f5ad0c-0558-477a-8319-87f995e4e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:20:31 user nova-compute[74261]: DEBUG nova.compute.manager [req-5a126276-3616-41c2-a179-1200e4e0b0b5 req-71702568-d20f-429b-a57d-06c1d27aa5a0 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] No waiting events found dispatching network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:20:31 user nova-compute[74261]: WARNING nova.compute.manager [req-5a126276-3616-41c2-a179-1200e4e0b0b5 req-71702568-d20f-429b-a57d-06c1d27aa5a0 service nova] [instance: 80f5ad0c-0558-477a-8319-87f995e4e065] Received unexpected event network-vif-plugged-6ec6c362-b6e3-4a2d-adab-e1ef346cc7bc for instance with vm_state deleted and task_state None.
Oct 17 12:20:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:20:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:20:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:20:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:20:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:20:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:20:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:20:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:20:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:20:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:20:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:20:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:20:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:20:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:21:13 user nova-compute[74261]: INFO nova.compute.claims [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Claim successful on node user
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:21:13 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:21:13 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.policy [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37a12e23c167417db843298e75de49cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2344eace8044549c9df70815cfc25c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:21:14 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Creating image(s)
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "/opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "/opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "/opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk 1073741824" returned: 0 in 0.048s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "892818900e050e9c3a61d090e85bf5aaa79a6a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk. size=1073741824 {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Successfully created port: b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.virt.disk.api [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Cannot resize image /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk to a smaller size. {{(pid=74261) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Ensure instance console log exists: /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:14 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Successfully updated port: b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-changed-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Refreshing instance network info cache due to event network-changed-b3e545e7-9dc0-46cb-9107-6a45df48165d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.neutron [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Instance network_info: |[{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.neutron [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Refreshing network info cache for port b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Start _get_guest_xml network_info=[{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': '2b60d4df-2b06-4b78-b4ef-1c17d613f5c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:21:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:21:15 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T11:40:20Z,direct_url=<?>,disk_format='qcow2',id=2b60d4df-2b06-4b78-b4ef-1c17d613f5c0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7acc9a7fd01240a2bfa6fff17ea14622',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T11:40:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1296003645',display_name='tempest-TestStampPattern-server-1296003645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1296003645',id=45,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuucJOW55DYiHQowqF5dsFtdYM7nDKLkdpo66szdSu6U02fRCEzcnkL/hTyVAgbHX7OrBMFxyCrQbocnpOcyDfV0WQBURWX7ZpzeU/yLVeyV8KpUsydF+v4fv2OaYgRvw==',key_name='tempest-TestStampPattern-251515459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2344eace8044549c9df70815cfc25c',ramdisk_id='',reservation_id='r-0qnm0oy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1179693229',owner_user_name='tempest-TestStampPattern-1179693229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:21:14Z,user_data=None,user_id='37a12e23c167417db843298e75de49cb',uuid=568bee30-c334-49bf-819c-b052d50ea84a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converting VIF {"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.objects.instance [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'pci_devices' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:21:15 user nova-compute[74261]:   <uuid>568bee30-c334-49bf-819c-b052d50ea84a</uuid>
Oct 17 12:21:15 user nova-compute[74261]:   <name>instance-0000002d</name>
Oct 17 12:21:15 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:21:15 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:21:15 user nova-compute[74261]:   <metadata>
Oct 17 12:21:15 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:21:15 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:21:15 user nova-compute[74261]:       <nova:name>tempest-TestStampPattern-server-1296003645</nova:name>
Oct 17 12:21:15 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:21:15</nova:creationTime>
Oct 17 12:21:15 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:21:15 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:21:15 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:21:15 user nova-compute[74261]:       <nova:owner>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:user uuid="37a12e23c167417db843298e75de49cb">tempest-TestStampPattern-1179693229-project-member</nova:user>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:project uuid="6d2344eace8044549c9df70815cfc25c">tempest-TestStampPattern-1179693229</nova:project>
Oct 17 12:21:15 user nova-compute[74261]:       </nova:owner>
Oct 17 12:21:15 user nova-compute[74261]:       <nova:root type="image" uuid="2b60d4df-2b06-4b78-b4ef-1c17d613f5c0"/>
Oct 17 12:21:15 user nova-compute[74261]:       <nova:ports>
Oct 17 12:21:15 user nova-compute[74261]:         <nova:port uuid="b3e545e7-9dc0-46cb-9107-6a45df48165d">
Oct 17 12:21:15 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 12:21:15 user nova-compute[74261]:         </nova:port>
Oct 17 12:21:15 user nova-compute[74261]:       </nova:ports>
Oct 17 12:21:15 user nova-compute[74261]:     </nova:instance>
Oct 17 12:21:15 user nova-compute[74261]:   </metadata>
Oct 17 12:21:15 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:21:15 user nova-compute[74261]:     <system>
Oct 17 12:21:15 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:21:15 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:21:15 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:21:15 user nova-compute[74261]:       <entry name="serial">568bee30-c334-49bf-819c-b052d50ea84a</entry>
Oct 17 12:21:15 user nova-compute[74261]:       <entry name="uuid">568bee30-c334-49bf-819c-b052d50ea84a</entry>
Oct 17 12:21:15 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:21:15 user nova-compute[74261]:     </system>
Oct 17 12:21:15 user nova-compute[74261]:   </sysinfo>
Oct 17 12:21:15 user nova-compute[74261]:   <os>
Oct 17 12:21:15 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:21:15 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:21:15 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:21:15 user nova-compute[74261]:   </os>
Oct 17 12:21:15 user nova-compute[74261]:   <features>
Oct 17 12:21:15 user nova-compute[74261]:     <acpi/>
Oct 17 12:21:15 user nova-compute[74261]:     <apic/>
Oct 17 12:21:15 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:21:15 user nova-compute[74261]:   </features>
Oct 17 12:21:15 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:21:15 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:21:15 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:21:15 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:21:15 user nova-compute[74261]:   </clock>
Oct 17 12:21:15 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:21:15 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:21:15 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:21:15 user nova-compute[74261]:   </cpu>
Oct 17 12:21:15 user nova-compute[74261]:   <devices>
Oct 17 12:21:15 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:21:15 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:21:15 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk"/>
Oct 17 12:21:15 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:21:15 user nova-compute[74261]:     </disk>
Oct 17 12:21:15 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:21:15 user nova-compute[74261]:       <mac address="fa:16:3e:cf:d7:60"/>
Oct 17 12:21:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:21:15 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:21:15 user nova-compute[74261]:       <target dev="tapb3e545e7-9d"/>
Oct 17 12:21:15 user nova-compute[74261]:     </interface>
Oct 17 12:21:15 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:21:15 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/console.log" append="off"/>
Oct 17 12:21:15 user nova-compute[74261]:     </serial>
Oct 17 12:21:15 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:21:15 user nova-compute[74261]:     <video>
Oct 17 12:21:15 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:21:15 user nova-compute[74261]:     </video>
Oct 17 12:21:15 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:21:15 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:21:15 user nova-compute[74261]:     </rng>
Oct 17 12:21:15 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:21:15 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:21:15 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:21:15 user nova-compute[74261]:     </memballoon>
Oct 17 12:21:15 user nova-compute[74261]:   </devices>
Oct 17 12:21:15 user nova-compute[74261]: </domain>
Oct 17 12:21:15 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1296003645',display_name='tempest-TestStampPattern-server-1296003645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1296003645',id=45,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuucJOW55DYiHQowqF5dsFtdYM7nDKLkdpo66szdSu6U02fRCEzcnkL/hTyVAgbHX7OrBMFxyCrQbocnpOcyDfV0WQBURWX7ZpzeU/yLVeyV8KpUsydF+v4fv2OaYgRvw==',key_name='tempest-TestStampPattern-251515459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2344eace8044549c9df70815cfc25c',ramdisk_id='',reservation_id='r-0qnm0oy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1179693229',owner_user_name='tempest-TestStampPattern-1179693229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:21:14Z,user_data=None,user_id='37a12e23c167417db843298e75de49cb',uuid=568bee30-c334-49bf-819c-b052d50ea84a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converting VIF {"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG os_vif [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0ae6baf-d6f5-5226-8123-e0959050ae0e', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3e545e7-9d, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3e545e7-9d, col_values=(('qos', UUID('fdd3ee38-cc19-4d8b-9047-192ab9d3ceaf')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3e545e7-9d, col_values=(('external_ids', {'iface-id': 'b3e545e7-9dc0-46cb-9107-6a45df48165d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:d7:60', 'vm-uuid': '568bee30-c334-49bf-819c-b052d50ea84a'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:15 user nova-compute[74261]: INFO os_vif [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d')
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:21:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No VIF found with MAC fa:16:3e:cf:d7:60, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:21:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated VIF entry in instance network info cache for port b3e545e7-9dc0-46cb-9107-6a45df48165d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:21:16 user nova-compute[74261]: DEBUG nova.network.neutron [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:21:16 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c805f899-5121-4849-9313-2fa0f4ee6d64 req-8dc013b7-ac5b-4b7d-80aa-8e40e9d2cafe service nova] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-02ec7b1d-e053-4826-a33d-7061a356d84d req-b61b0542-b859-4024-b5ec-f7ec244a9b57 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02ec7b1d-e053-4826-a33d-7061a356d84d req-b61b0542-b859-4024-b5ec-f7ec244a9b57 service nova] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02ec7b1d-e053-4826-a33d-7061a356d84d req-b61b0542-b859-4024-b5ec-f7ec244a9b57 service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-02ec7b1d-e053-4826-a33d-7061a356d84d req-b61b0542-b859-4024-b5ec-f7ec244a9b57 service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG nova.compute.manager [req-02ec7b1d-e053-4826-a33d-7061a356d84d req-b61b0542-b859-4024-b5ec-f7ec244a9b57 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] No waiting events found dispatching network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:21:17 user nova-compute[74261]: WARNING nova.compute.manager [req-02ec7b1d-e053-4826-a33d-7061a356d84d req-b61b0542-b859-4024-b5ec-f7ec244a9b57 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received unexpected event network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d for instance with vm_state building and task_state spawning.
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:21:19 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Instance spawned successfully.
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:21:19 user nova-compute[74261]: INFO nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Took 5.34 seconds to spawn the instance on the hypervisor.
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:21:19 user nova-compute[74261]: INFO nova.compute.manager [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Took 6.01 seconds to build instance.
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-4c59df0b-bb23-4ab2-bbe4-800653308689 req-55d2efef-5be1-427a-9e30-fc18ee5e56dc service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4c59df0b-bb23-4ab2-bbe4-800653308689 req-55d2efef-5be1-427a-9e30-fc18ee5e56dc service nova] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4c59df0b-bb23-4ab2-bbe4-800653308689 req-55d2efef-5be1-427a-9e30-fc18ee5e56dc service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4c59df0b-bb23-4ab2-bbe4-800653308689 req-55d2efef-5be1-427a-9e30-fc18ee5e56dc service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-4c59df0b-bb23-4ab2-bbe4-800653308689 req-55d2efef-5be1-427a-9e30-fc18ee5e56dc service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] No waiting events found dispatching network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:21:19 user nova-compute[74261]: WARNING nova.compute.manager [req-4c59df0b-bb23-4ab2-bbe4-800653308689 req-55d2efef-5be1-427a-9e30-fc18ee5e56dc service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received unexpected event network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d for instance with vm_state active and task_state None.
Oct 17 12:21:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-7bad457a-ca82-4d37-8e33-a7bd7592d3bf tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.148s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:20 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:26 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:21:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "568bee30-c334-49bf-819c-b052d50ea84a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "568bee30-c334-49bf-819c-b052d50ea84a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:29 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:21:31 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:21:31 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.227855682373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:21:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:21:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:21:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:21:36 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:21:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:21:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:21:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:21:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:21:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:22:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:22:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:22 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:26 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:22:31 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:22:31 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=25.19955062866211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:22:31 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:22:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:32 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:22:33 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:22:37 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:22:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:22:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:22:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:22:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:22:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:22:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-changed-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:23:05 user nova-compute[74261]: DEBUG nova.compute.manager [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Refreshing instance network info cache due to event network-changed-b3e545e7-9dc0-46cb-9107-6a45df48165d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:23:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:23:05 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:23:05 user nova-compute[74261]: DEBUG nova.network.neutron [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Refreshing network info cache for port b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:23:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated VIF entry in instance network info cache for port b3e545e7-9dc0-46cb-9107-6a45df48165d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG nova.network.neutron [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6d7ad6d4-8a2c-4359-839b-eec2e58b415b req-6c5c1e7b-5a0f-44f3-a2e0-27d7428d4a75 service nova] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'flavor' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:23:06 user nova-compute[74261]: INFO nova.compute.manager [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Attaching volume b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 to /dev/vdb
Oct 17 12:23:06 user nova-compute[74261]: DEBUG os_brick.utils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[124634f4-3d05-456f-a936-386edcc22672]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[703c3dd3-c64b-4fc2-9c98-fd58e54eefbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d895266-9dc6-4af3-826b-8d0882c809c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[809bf290-6fa1-4635-8d50-2a5c09526a5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:23:06 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:23:06 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18516d4-3273-4854-878b-bfbba6004a0a]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG os_brick.utils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:23:06 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating existing volume attachment record: ff38f391-23ca-43dc-b185-54f8dda281e1 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:23:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYuWhPIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:23:21 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:23:21 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:23:21 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:23:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b7733-4785-4800-a72d-4865ee97793b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:23:21 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8182fdb-7d8a-4ce7-8c46-a74816ce9d1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:21 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21] added
Oct 17 12:23:21 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e158f62-df72-47f4-b606-18d72ccb9a79]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3121bf47-0529-4b7c-bf71-c059c91317bd]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYuWhPIm {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYuWhPIm" returned: 0 in 0.045s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3e8af4-a7df-43fc-bdde-bc48c9413442]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VYuWhPIm'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d9117d-0b06-4b9b-bac7-020c13177649]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a622987-2a4e-42ea-9fa0-2a8b1d25d4d1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:23:22 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:23:22 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:23:22 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:23:22 user nova-compute[74261]: 
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ec4b8-8475-441a-9564-b3c88a2b728f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260]
Oct 17 12:23:22 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260] successful.
Oct 17 12:23:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f6f95-53a3-415b-9b48-108088f0e6c6]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb0c757-cf0e-467f-beb3-52e213eef047]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 (non-flash)
Oct 17 12:23:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 (non-flash)
Oct 17 12:23:22 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[606836ca-d654-4818-b70b-7dab4b507316]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:23:22 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYuWhPIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23564306461363430', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564306461363430', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG nova.objects.instance [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'flavor' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:23:23 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:23:23 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:23:23 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:23:23 user nova-compute[74261]:   <serial>b19e2ebd-8fc5-4540-a79a-d9a04ce20d21</serial>
Oct 17 12:23:23 user nova-compute[74261]: </disk>
Oct 17 12:23:23 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No VIF found with MAC fa:16:3e:cf:d7:60, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:23:23 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-e509584a-3dc8-4834-b240-64d03f1e00da tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.446s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:23:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:23:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:23:26 user nova-compute[74261]: INFO nova.compute.manager [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Detaching volume b19e2ebd-8fc5-4540-a79a-d9a04ce20d21
Oct 17 12:23:26 user nova-compute[74261]: INFO nova.virt.block_device [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Attempting to driver detach volume b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 from mountpoint /dev/vdb
Oct 17 12:23:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Attempting to detach device vdb from instance 568bee30-c334-49bf-819c-b052d50ea84a from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:23:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:23:26 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:23:26 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:23:26 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:23:26 user nova-compute[74261]:   <serial>b19e2ebd-8fc5-4540-a79a-d9a04ce20d21</serial>
Oct 17 12:23:26 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:23:26 user nova-compute[74261]: </disk>
Oct 17 12:23:26 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:23:26 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully detached device vdb from instance 568bee30-c334-49bf-819c-b052d50ea84a from the persistent domain config.
Oct 17 12:23:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 568bee30-c334-49bf-819c-b052d50ea84a from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:23:26 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:23:26 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:23:26 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:23:26 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:23:26 user nova-compute[74261]:   <serial>b19e2ebd-8fc5-4540-a79a-d9a04ce20d21</serial>
Oct 17 12:23:26 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:23:26 user nova-compute[74261]: </disk>
Oct 17 12:23:26 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:23:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:27 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:23:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:32 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:33 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:23:33 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.19842529296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:23:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:23:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:23:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:23:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:23:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:23:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:23:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:23:47 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 568bee30-c334-49bf-819c-b052d50ea84a is timed out.
Oct 17 12:23:47 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully detached device vdb from instance 568bee30-c334-49bf-819c-b052d50ea84a from the live domain config.
Oct 17 12:23:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYuWhPIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:23:47 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e02e86-0379-47d5-8782-88554de7e60e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:23:47 user nova-compute[74261]: No targets found.
Oct 17 12:23:47 user nova-compute[74261]: iSNS:
Oct 17 12:23:47 user nova-compute[74261]: No targets found.
Oct 17 12:23:47 user nova-compute[74261]: STATIC:
Oct 17 12:23:47 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21
Oct 17 12:23:47 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:23:47 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:23:47 user nova-compute[74261]: FIRMWARE:
Oct 17 12:23:47 user nova-compute[74261]: No targets found.
Oct 17 12:23:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:23:47 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:23:47 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea48bc-3c92-4984-b724-94c464d394c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[044283aa-07fe-4ea9-85d0-97e754d85839]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 (non-flash)
Oct 17 12:23:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 (non-flash)
Oct 17 12:23:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c104b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52b8e3f-1564-491d-a1f1-ef142df06c99]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcbcf31-fcf6-4486-b77e-27ee8362c6b9]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032babb-b4b6-4a7f-9fb5-f0b0681133b2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d537b-d3ca-44b5-a615-a6e73702aab7]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed90955-495a-40ba-870c-7da1867c7926]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d02ee-e288-47e2-b07f-1ed3f7b33b2b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260]
Oct 17 12:23:47 user nova-compute[74261]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21, portal: 172.16.0.220,3260] successful.
Oct 17 12:23:47 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19e2ebd-8fc5-4540-a79a-d9a04ce20d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22509b-d4b2-4bd3-812b-d804f1e4919a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] <== disconnect_volume: return (295ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:23:47 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:23:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'flavor' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:23:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-6a85e476-4d59-46a1-956b-ce232891da35 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:23:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:23:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:24:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:24:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:24:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:27 user nova-compute[74261]: DEBUG nova.compute.manager [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:24:27 user nova-compute[74261]: INFO nova.compute.manager [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] instance snapshotting
Oct 17 12:24:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:27 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Beginning live snapshot process
Oct 17 12:24:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json -f qcow2 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:27 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c --force-share --output=json" returned: 0 in 0.167s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzap0gcas/1640139b85504c62b6d82436aa5fb0c6.delta 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/892818900e050e9c3a61d090e85bf5aaa79a6a4c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzap0gcas/1640139b85504c62b6d82436aa5fb0c6.delta 1073741824" returned: 0 in 0.048s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:28 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 12:24:28 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 12:24:29 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74261) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 12:24:29 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 12:24:29 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 12:24:29 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzap0gcas/1640139b85504c62b6d82436aa5fb0c6.delta /opt/stack/data/nova/instances/snapshots/tmpzap0gcas/1640139b85504c62b6d82436aa5fb0c6 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:30 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzap0gcas/1640139b85504c62b6d82436aa5fb0c6.delta /opt/stack/data/nova/instances/snapshots/tmpzap0gcas/1640139b85504c62b6d82436aa5fb0c6" returned: 0 in 0.586s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:30 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Snapshot extracted, beginning image upload
Oct 17 12:24:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:32 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Snapshot image upload complete
Oct 17 12:24:32 user nova-compute[74261]: INFO nova.compute.manager [None req-06578391-aa70-4c81-8a24-6192a91c8423 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Took 5.14 seconds to snapshot the instance on the hypervisor.
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:24:35 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:24:35 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.148670196533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dcc5ff42-cf38-476d-824a-0391edd98604 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.167s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:24:35 user nova-compute[74261]: INFO nova.compute.claims [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Claim successful on node user
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:24:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:35 user nova-compute[74261]: DEBUG nova.policy [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37a12e23c167417db843298e75de49cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2344eace8044549c9df70815cfc25c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:24:36 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Creating image(s)
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "/opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "/opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "f2da7748d9c85e49c3cb92b8b90638b0478ebeb5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "f2da7748d9c85e49c3cb92b8b90638b0478ebeb5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.part --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:36 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Successfully created port: f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.part --force-share --output=json" returned: 0 in 0.216s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.virt.images [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] f8de03be-a8e8-4133-865c-dd65113fbd35 was qcow2, converting to raw {{(pid=74261) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.privsep.utils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74261) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.part /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.converted {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.part /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.converted" returned: 0 in 0.400s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.converted --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "f2da7748d9c85e49c3cb92b8b90638b0478ebeb5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.742s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Successfully updated port: f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquired lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-changed-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.compute.manager [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Refreshing instance network info cache due to event network-changed-f9dc61b1-cc85-461c-8f5b-5bba21b2035f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] Acquiring lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5 --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "f2da7748d9c85e49c3cb92b8b90638b0478ebeb5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "f2da7748d9c85e49c3cb92b8b90638b0478ebeb5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5 --force-share --output=json" returned: 0 in 0.165s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5,backing_fmt=raw /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk 1073741824 {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5,backing_fmt=raw /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk 1073741824" returned: 0 in 0.048s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "f2da7748d9c85e49c3cb92b8b90638b0478ebeb5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5 --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.neutron [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Releasing lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Instance network_info: |[{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] Acquired lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Refreshing network info cache for port f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2da7748d9c85e49c3cb92b8b90638b0478ebeb5 --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Created local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Ensure instance console log exists: /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Start _get_guest_xml network_info=[{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='424a0af411c7c7a732ba27e00adad4f7',container_format='bare',created_at=2023-10-17T12:24:27Z,direct_url=<?>,disk_format='qcow2',id=f8de03be-a8e8-4133-865c-dd65113fbd35,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1673603012',owner='6d2344eace8044549c9df70815cfc25c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T12:24:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'image_id': 'f8de03be-a8e8-4133-865c-dd65113fbd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:24:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:24:38 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='424a0af411c7c7a732ba27e00adad4f7',container_format='bare',created_at=2023-10-17T12:24:27Z,direct_url=<?>,disk_format='qcow2',id=f8de03be-a8e8-4133-865c-dd65113fbd35,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1673603012',owner='6d2344eace8044549c9df70815cfc25c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T12:24:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-30370741',display_name='tempest-TestStampPattern-server-30370741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-30370741',id=46,image_ref='f8de03be-a8e8-4133-865c-dd65113fbd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuucJOW55DYiHQowqF5dsFtdYM7nDKLkdpo66szdSu6U02fRCEzcnkL/hTyVAgbHX7OrBMFxyCrQbocnpOcyDfV0WQBURWX7ZpzeU/yLVeyV8KpUsydF+v4fv2OaYgRvw==',key_name='tempest-TestStampPattern-251515459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2344eace8044549c9df70815cfc25c',ramdisk_id='',reservation_id='r-60k1zzdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='568bee30-c334-49bf-819c-b052d50ea84a',image_min_disk='1',image_min_ram='0',image_owner_id='6d2344eace8044549c9df70815cfc25c',image_owner_project_name='tempest-TestStampPattern-1179693229',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1179693229-project-member',image_user_id='37a12e23c167417db843298e75de49cb',network_allocated='True',owner_project_name='tempest-TestStampPattern-1179693229',owner_user_name='tempest-TestStampPattern-1179693229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:24:36Z,user_data=None,user_id='37a12e23c167417db843298e75de49cb',uuid=dcc5ff42-cf38-476d-824a-0391edd98604,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converting VIF {"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'pci_devices' on Instance uuid dcc5ff42-cf38-476d-824a-0391edd98604 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:24:38 user nova-compute[74261]:   <uuid>dcc5ff42-cf38-476d-824a-0391edd98604</uuid>
Oct 17 12:24:38 user nova-compute[74261]:   <name>instance-0000002e</name>
Oct 17 12:24:38 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:24:38 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:24:38 user nova-compute[74261]:   <metadata>
Oct 17 12:24:38 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:24:38 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:24:38 user nova-compute[74261]:       <nova:name>tempest-TestStampPattern-server-30370741</nova:name>
Oct 17 12:24:38 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:24:38</nova:creationTime>
Oct 17 12:24:38 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:24:38 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:24:38 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:24:38 user nova-compute[74261]:       <nova:owner>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:user uuid="37a12e23c167417db843298e75de49cb">tempest-TestStampPattern-1179693229-project-member</nova:user>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:project uuid="6d2344eace8044549c9df70815cfc25c">tempest-TestStampPattern-1179693229</nova:project>
Oct 17 12:24:38 user nova-compute[74261]:       </nova:owner>
Oct 17 12:24:38 user nova-compute[74261]:       <nova:root type="image" uuid="f8de03be-a8e8-4133-865c-dd65113fbd35"/>
Oct 17 12:24:38 user nova-compute[74261]:       <nova:ports>
Oct 17 12:24:38 user nova-compute[74261]:         <nova:port uuid="f9dc61b1-cc85-461c-8f5b-5bba21b2035f">
Oct 17 12:24:38 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 12:24:38 user nova-compute[74261]:         </nova:port>
Oct 17 12:24:38 user nova-compute[74261]:       </nova:ports>
Oct 17 12:24:38 user nova-compute[74261]:     </nova:instance>
Oct 17 12:24:38 user nova-compute[74261]:   </metadata>
Oct 17 12:24:38 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:24:38 user nova-compute[74261]:     <system>
Oct 17 12:24:38 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:24:38 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:24:38 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:24:38 user nova-compute[74261]:       <entry name="serial">dcc5ff42-cf38-476d-824a-0391edd98604</entry>
Oct 17 12:24:38 user nova-compute[74261]:       <entry name="uuid">dcc5ff42-cf38-476d-824a-0391edd98604</entry>
Oct 17 12:24:38 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:24:38 user nova-compute[74261]:     </system>
Oct 17 12:24:38 user nova-compute[74261]:   </sysinfo>
Oct 17 12:24:38 user nova-compute[74261]:   <os>
Oct 17 12:24:38 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:24:38 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:24:38 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:24:38 user nova-compute[74261]:   </os>
Oct 17 12:24:38 user nova-compute[74261]:   <features>
Oct 17 12:24:38 user nova-compute[74261]:     <acpi/>
Oct 17 12:24:38 user nova-compute[74261]:     <apic/>
Oct 17 12:24:38 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:24:38 user nova-compute[74261]:   </features>
Oct 17 12:24:38 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:24:38 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:24:38 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:24:38 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:24:38 user nova-compute[74261]:   </clock>
Oct 17 12:24:38 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:24:38 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:24:38 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:24:38 user nova-compute[74261]:   </cpu>
Oct 17 12:24:38 user nova-compute[74261]:   <devices>
Oct 17 12:24:38 user nova-compute[74261]:     <disk type="file" device="disk">
Oct 17 12:24:38 user nova-compute[74261]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 12:24:38 user nova-compute[74261]:       <source file="/opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk"/>
Oct 17 12:24:38 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:24:38 user nova-compute[74261]:     </disk>
Oct 17 12:24:38 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:24:38 user nova-compute[74261]:       <mac address="fa:16:3e:0f:6c:26"/>
Oct 17 12:24:38 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:24:38 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:24:38 user nova-compute[74261]:       <target dev="tapf9dc61b1-cc"/>
Oct 17 12:24:38 user nova-compute[74261]:     </interface>
Oct 17 12:24:38 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:24:38 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/console.log" append="off"/>
Oct 17 12:24:38 user nova-compute[74261]:     </serial>
Oct 17 12:24:38 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:24:38 user nova-compute[74261]:     <video>
Oct 17 12:24:38 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:24:38 user nova-compute[74261]:     </video>
Oct 17 12:24:38 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:24:38 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:24:38 user nova-compute[74261]:     </rng>
Oct 17 12:24:38 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:24:38 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:24:38 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:24:38 user nova-compute[74261]:     </memballoon>
Oct 17 12:24:38 user nova-compute[74261]:   </devices>
Oct 17 12:24:38 user nova-compute[74261]: </domain>
Oct 17 12:24:38 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-30370741',display_name='tempest-TestStampPattern-server-30370741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-30370741',id=46,image_ref='f8de03be-a8e8-4133-865c-dd65113fbd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuucJOW55DYiHQowqF5dsFtdYM7nDKLkdpo66szdSu6U02fRCEzcnkL/hTyVAgbHX7OrBMFxyCrQbocnpOcyDfV0WQBURWX7ZpzeU/yLVeyV8KpUsydF+v4fv2OaYgRvw==',key_name='tempest-TestStampPattern-251515459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2344eace8044549c9df70815cfc25c',ramdisk_id='',reservation_id='r-60k1zzdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='568bee30-c334-49bf-819c-b052d50ea84a',image_min_disk='1',image_min_ram='0',image_owner_id='6d2344eace8044549c9df70815cfc25c',image_owner_project_name='tempest-TestStampPattern-1179693229',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1179693229-project-member',image_user_id='37a12e23c167417db843298e75de49cb',network_allocated='True',owner_project_name='tempest-TestStampPattern-1179693229',owner_user_name='tempest-TestStampPattern-1179693229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:24:36Z,user_data=None,user_id='37a12e23c167417db843298e75de49cb',uuid=dcc5ff42-cf38-476d-824a-0391edd98604,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converting VIF {"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG os_vif [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '227a8a8b-59a8-5e17-b1d3-c18124985ba0', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9dc61b1-cc, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9dc61b1-cc, col_values=(('qos', UUID('a188f082-1ead-4c57-a71f-1392c2bb6c81')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9dc61b1-cc, col_values=(('external_ids', {'iface-id': 'f9dc61b1-cc85-461c-8f5b-5bba21b2035f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:6c:26', 'vm-uuid': 'dcc5ff42-cf38-476d-824a-0391edd98604'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:38 user nova-compute[74261]: INFO os_vif [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc')
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No VIF found with MAC fa:16:3e:0f:6c:26, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updated VIF entry in instance network info cache for port f9dc61b1-cc85-461c-8f5b-5bba21b2035f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:24:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-bd1fc58f-5e70-4a01-aa86-1096535a4786 req-edfa2bff-e312-4255-89ad-90dcf0160c00 service nova] Releasing lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-9f8ad4df-4e98-4e9c-87f4-93fd4b0c3a1f req-1d3057e4-d822-4f69-818f-7dc2a2643649 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9f8ad4df-4e98-4e9c-87f4-93fd4b0c3a1f req-1d3057e4-d822-4f69-818f-7dc2a2643649 service nova] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9f8ad4df-4e98-4e9c-87f4-93fd4b0c3a1f req-1d3057e4-d822-4f69-818f-7dc2a2643649 service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9f8ad4df-4e98-4e9c-87f4-93fd4b0c3a1f req-1d3057e4-d822-4f69-818f-7dc2a2643649 service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-9f8ad4df-4e98-4e9c-87f4-93fd4b0c3a1f req-1d3057e4-d822-4f69-818f-7dc2a2643649 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] No waiting events found dispatching network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:24:39 user nova-compute[74261]: WARNING nova.compute.manager [req-9f8ad4df-4e98-4e9c-87f4-93fd4b0c3a1f req-1d3057e4-d822-4f69-818f-7dc2a2643649 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received unexpected event network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f for instance with vm_state building and task_state spawning.
Oct 17 12:24:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:24:41 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Instance spawned successfully.
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:24:41 user nova-compute[74261]: INFO nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Took 5.97 seconds to spawn the instance on the hypervisor.
Oct 17 12:24:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:24:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-daabfbb7-49df-461f-90c7-8ffcb9a6d190 req-080d202b-e47b-4b87-b5d1-6cb6c828ff8a service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:24:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-daabfbb7-49df-461f-90c7-8ffcb9a6d190 req-080d202b-e47b-4b87-b5d1-6cb6c828ff8a service nova] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:24:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-daabfbb7-49df-461f-90c7-8ffcb9a6d190 req-080d202b-e47b-4b87-b5d1-6cb6c828ff8a service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:24:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-daabfbb7-49df-461f-90c7-8ffcb9a6d190 req-080d202b-e47b-4b87-b5d1-6cb6c828ff8a service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-daabfbb7-49df-461f-90c7-8ffcb9a6d190 req-080d202b-e47b-4b87-b5d1-6cb6c828ff8a service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] No waiting events found dispatching network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:24:42 user nova-compute[74261]: WARNING nova.compute.manager [req-daabfbb7-49df-461f-90c7-8ffcb9a6d190 req-080d202b-e47b-4b87-b5d1-6cb6c828ff8a service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received unexpected event network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f for instance with vm_state building and task_state spawning.
Oct 17 12:24:42 user nova-compute[74261]: INFO nova.compute.manager [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Took 6.79 seconds to build instance.
Oct 17 12:24:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ff380fb9-008e-461d-b405-04eefbdbd8b8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.162s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:24:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:24:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:24:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:24:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:25 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:25:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:31 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:25:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:25:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:25:37 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:25:37 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8927MB free_disk=25.05167007446289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dcc5ff42-cf38-476d-824a-0391edd98604 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:25:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:25:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:25:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:25:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:25:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:25:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:25:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:25:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:25:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:25:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:25:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:25:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:25:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:25:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:25:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:25:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:25:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:25:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:26:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:26:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-changed-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:26:26 user nova-compute[74261]: DEBUG nova.compute.manager [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Refreshing instance network info cache due to event network-changed-f9dc61b1-cc85-461c-8f5b-5bba21b2035f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:26:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] Acquiring lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:26:26 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] Acquired lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:26:26 user nova-compute[74261]: DEBUG nova.network.neutron [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Refreshing network info cache for port f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:26:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:27 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:27 user nova-compute[74261]: DEBUG nova.network.neutron [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updated VIF entry in instance network info cache for port f9dc61b1-cc85-461c-8f5b-5bba21b2035f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:26:27 user nova-compute[74261]: DEBUG nova.network.neutron [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:26:27 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-51a905f9-8ea0-4226-a1c1-16effd7e42a9 req-9eb09c3c-3289-4534-984c-e29d3a9885ed service nova] Releasing lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'flavor' on Instance uuid dcc5ff42-cf38-476d-824a-0391edd98604 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:26:28 user nova-compute[74261]: INFO nova.compute.manager [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Attaching volume 8b25ff77-9371-4c81-a2e3-e177ed8e82e2 to /dev/vdb
Oct 17 12:26:28 user nova-compute[74261]: DEBUG os_brick.utils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e24284-c2fb-4ba9-8259-8c5bb953a3e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36b120e-8ede-4426-8419-c1584e0a263e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3f41f6-aa59-4784-baac-370a9f777cb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59771bcb-aa46-4d3f-beb7-e92ffc4ed495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:26:28 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:26:28 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7db213-17d5-4b81-b85b-93a06d82237d]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG os_brick.utils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:26:28 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating existing volume attachment record: 990b7e41-7b66-4c66-a6ed-9df101bbbe2a {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:26:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:31 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:36 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:37 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:26:37 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.05084991455078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dcc5ff42-cf38-476d-824a-0391edd98604 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:26:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:26:38 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:26:38 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:26:38 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:26:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:26:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:26:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opuezRIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:26:43 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:26:43 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:26:43 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8dddf3-ed9c-44f3-9bc3-7d3e951f1a84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:26:43 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5486449-bb29-4277-af95-0606a636640e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2] added
Oct 17 12:26:43 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e106953f-3ae9-4885-b7ed-1bb5c9be5af2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:43 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1fd1b4-b1d3-4c55-9f4e-c37b0519db49]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opuezRIg {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opuezRIg" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[36adbc27-87af-4120-b3ab-50f03648e3d3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opuezRIg'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[941b59d9-fb1d-4363-a0eb-d31aef2664bd]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca6dcf2-c817-4f39-9373-13945199fa55]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:26:44 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:26:44 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:26:44 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:26:44 user nova-compute[74261]: 
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3893a19-f477-492d-8ce8-eecc9f9a7a9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260]
Oct 17 12:26:44 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260] successful.
Oct 17 12:26:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdcb0e1-c5de-47fc-aae3-355b71ed009d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee630816-bbf3-4bfe-ae1f-23ab41773ac9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 (non-flash)
Oct 17 12:26:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 (non-flash)
Oct 17 12:26:44 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e512b784-814d-4d06-9f55-672699b42ef5]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:26:44 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opuezRIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23933623037613565', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933623037613565', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG nova.objects.instance [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'flavor' on Instance uuid dcc5ff42-cf38-476d-824a-0391edd98604 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 12:26:45 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:26:45 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:26:45 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:26:45 user nova-compute[74261]:   <serial>8b25ff77-9371-4c81-a2e3-e177ed8e82e2</serial>
Oct 17 12:26:45 user nova-compute[74261]: </disk>
Oct 17 12:26:45 user nova-compute[74261]:  {{(pid=74261) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] No VIF found with MAC fa:16:3e:0f:6c:26, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:26:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d6e-0795-4b41-bf84-47eb83cd6542 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.285s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:26:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:26:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:26:48 user nova-compute[74261]: INFO nova.compute.manager [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Detaching volume 8b25ff77-9371-4c81-a2e3-e177ed8e82e2
Oct 17 12:26:48 user nova-compute[74261]: INFO nova.virt.block_device [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Attempting to driver detach volume 8b25ff77-9371-4c81-a2e3-e177ed8e82e2 from mountpoint /dev/vdb
Oct 17 12:26:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Attempting to detach device vdb from instance dcc5ff42-cf38-476d-824a-0391edd98604 from the persistent domain config. {{(pid=74261) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 12:26:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:26:48 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:26:48 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:26:48 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:26:48 user nova-compute[74261]:   <serial>8b25ff77-9371-4c81-a2e3-e177ed8e82e2</serial>
Oct 17 12:26:48 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:26:48 user nova-compute[74261]: </disk>
Oct 17 12:26:48 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:26:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully detached device vdb from instance dcc5ff42-cf38-476d-824a-0391edd98604 from the persistent domain config.
Oct 17 12:26:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcc5ff42-cf38-476d-824a-0391edd98604 from the live domain config. {{(pid=74261) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 12:26:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.guest [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 12:26:48 user nova-compute[74261]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:26:48 user nova-compute[74261]:   <source dev="/dev/sdb"/>
Oct 17 12:26:48 user nova-compute[74261]:   <target dev="vdb" bus="virtio"/>
Oct 17 12:26:48 user nova-compute[74261]:   <serial>8b25ff77-9371-4c81-a2e3-e177ed8e82e2</serial>
Oct 17 12:26:48 user nova-compute[74261]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 12:26:48 user nova-compute[74261]: </disk>
Oct 17 12:26:48 user nova-compute[74261]:  {{(pid=74261) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 12:26:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcc5ff42-cf38-476d-824a-0391edd98604 {{(pid=74261) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 12:26:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:26:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:26:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:08 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dcc5ff42-cf38-476d-824a-0391edd98604 is timed out.
Oct 17 12:27:08 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully detached device vdb from instance dcc5ff42-cf38-476d-824a-0391edd98604 from the live domain config.
Oct 17 12:27:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opuezRIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:27:08 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5d7c6-5ba1-4887-b5f2-f49974f890c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:27:08 user nova-compute[74261]: No targets found.
Oct 17 12:27:08 user nova-compute[74261]: iSNS:
Oct 17 12:27:08 user nova-compute[74261]: No targets found.
Oct 17 12:27:08 user nova-compute[74261]: STATIC:
Oct 17 12:27:08 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2
Oct 17 12:27:08 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:27:08 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:27:08 user nova-compute[74261]: FIRMWARE:
Oct 17 12:27:08 user nova-compute[74261]: No targets found.
Oct 17 12:27:08 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:27:08 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:27:08 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[08473a76-c4fd-4586-b34f-484b68965c14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1178e2-1cea-4bb7-afbe-6350e6949f68]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 (non-flash)
Oct 17 12:27:08 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 (non-flash)
Oct 17 12:27:08 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c269bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb13bb8d-670f-46e6-88a3-528e81976d00]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec95ca-f832-4f1e-97f4-f77ec47cac5a]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dd20f9-1d53-48a6-a171-3be031fb7313]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c86cca-df77-441c-9d87-5cf71a691b93]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c743870-ba29-4f9f-9080-bb95ba2d1de1]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da42dd-d45d-4098-a8fd-e0dd68d017a1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260]
Oct 17 12:27:08 user nova-compute[74261]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2, portal: 172.16.0.220,3260] successful.
Oct 17 12:27:08 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b25ff77-9371-4c81-a2e3-e177ed8e82e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae643d0-9b05-49ad-9e9a-cf57c4aaf203]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] <== disconnect_volume: return (291ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:27:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:27:09 user nova-compute[74261]: DEBUG nova.objects.instance [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'flavor' on Instance uuid dcc5ff42-cf38-476d-824a-0391edd98604 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:27:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-bdd4e5a4-0678-47a0-957a-52e2b6e6dde8 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:30 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:38 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-changed-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Refreshing instance network info cache due to event network-changed-f9dc61b1-cc85-461c-8f5b-5bba21b2035f. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] Acquiring lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] Acquired lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Refreshing network info cache for port f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:39 user nova-compute[74261]: INFO nova.compute.manager [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Terminating instance
Oct 17 12:27:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-25ff7a26-e9a0-4a7d-be4f-b5582f2adbd5 req-0fb229ff-ee3b-475a-9a8b-2ebab03c299a service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-vif-unplugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25ff7a26-e9a0-4a7d-be4f-b5582f2adbd5 req-0fb229ff-ee3b-475a-9a8b-2ebab03c299a service nova] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25ff7a26-e9a0-4a7d-be4f-b5582f2adbd5 req-0fb229ff-ee3b-475a-9a8b-2ebab03c299a service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-25ff7a26-e9a0-4a7d-be4f-b5582f2adbd5 req-0fb229ff-ee3b-475a-9a8b-2ebab03c299a service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-25ff7a26-e9a0-4a7d-be4f-b5582f2adbd5 req-0fb229ff-ee3b-475a-9a8b-2ebab03c299a service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] No waiting events found dispatching network-vif-unplugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-25ff7a26-e9a0-4a7d-be4f-b5582f2adbd5 req-0fb229ff-ee3b-475a-9a8b-2ebab03c299a service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-vif-unplugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:27:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:27:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.049968719482422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Instance destroyed successfully.
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.objects.instance [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'resources' on Instance uuid dcc5ff42-cf38-476d-824a-0391edd98604 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-30370741',display_name='tempest-TestStampPattern-server-30370741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-30370741',id=46,image_ref='f8de03be-a8e8-4133-865c-dd65113fbd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuucJOW55DYiHQowqF5dsFtdYM7nDKLkdpo66szdSu6U02fRCEzcnkL/hTyVAgbHX7OrBMFxyCrQbocnpOcyDfV0WQBURWX7ZpzeU/yLVeyV8KpUsydF+v4fv2OaYgRvw==',key_name='tempest-TestStampPattern-251515459',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2344eace8044549c9df70815cfc25c',ramdisk_id='',reservation_id='r-60k1zzdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='568bee30-c334-49bf-819c-b052d50ea84a',image_min_disk='1',image_min_ram='0',image_owner_id='6d2344eace8044549c9df70815cfc25c',image_owner_project_name='tempest-TestStampPattern-1179693229',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1179693229-project-member',image_user_id='37a12e23c167417db843298e75de49cb',owner_project_name='tempest-TestStampPattern-1179693229',owner_user_name='tempest-TestStampPattern-1179693229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:24:42Z,user_data=None,user_id='37a12e23c167417db843298e75de49cb',uuid=dcc5ff42-cf38-476d-824a-0391edd98604,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converting VIF {"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG os_vif [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9dc61b1-cc, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a188f082-1ead-4c57-a71f-1392c2bb6c81) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:40 user nova-compute[74261]: INFO os_vif [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:6c:26,bridge_name='br-int',has_traffic_filtering=True,id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dc61b1-cc')
Oct 17 12:27:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Deleting instance files /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604_del
Oct 17 12:27:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Deletion of /opt/stack/data/nova/instances/dcc5ff42-cf38-476d-824a-0391edd98604_del complete
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance dcc5ff42-cf38-476d-824a-0391edd98604 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:27:40 user nova-compute[74261]: INFO nova.compute.manager [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updated VIF entry in instance network info cache for port f9dc61b1-cc85-461c-8f5b-5bba21b2035f. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [{"id": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "address": "fa:16:3e:0f:6c:26", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dc61b1-cc", "ovs_interfaceid": "f9dc61b1-cc85-461c-8f5b-5bba21b2035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-b63ff725-3917-4838-b03d-7862b6649fb5 req-d81558c1-7e26-4c97-a134-e7276dcb728d service nova] Releasing lock "refresh_cache-dcc5ff42-cf38-476d-824a-0391edd98604" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:27:40 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Took 0.54 seconds to deallocate network for instance.
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-8cef6e73-06a0-44dc-affa-8e387d6e248c req-aa821eff-297b-4bab-b451-bd8fde8a54ea service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-vif-deleted-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:27:40 user nova-compute[74261]: INFO nova.compute.manager [req-8cef6e73-06a0-44dc-affa-8e387d6e248c req-aa821eff-297b-4bab-b451-bd8fde8a54ea service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Neutron deleted interface f9dc61b1-cc85-461c-8f5b-5bba21b2035f; detaching it from the instance and deleting it from the info cache
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-8cef6e73-06a0-44dc-affa-8e387d6e248c req-aa821eff-297b-4bab-b451-bd8fde8a54ea service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.manager [req-8cef6e73-06a0-44dc-affa-8e387d6e248c req-aa821eff-297b-4bab-b451-bd8fde8a54ea service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Detach interface failed, port_id=f9dc61b1-cc85-461c-8f5b-5bba21b2035f, reason: Instance dcc5ff42-cf38-476d-824a-0391edd98604 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:27:40 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:41 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Deleted allocations for instance dcc5ff42-cf38-476d-824a-0391edd98604
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-13d77ec4-bfd1-494f-a024-70a50c5d0c47 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "dcc5ff42-cf38-476d-824a-0391edd98604" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-aca80a7e-ac9d-4c3e-9380-627f9ee2f609 req-5d008c5b-b000-46c0-9154-49e67681cdb0 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received event network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-aca80a7e-ac9d-4c3e-9380-627f9ee2f609 req-5d008c5b-b000-46c0-9154-49e67681cdb0 service nova] Acquiring lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-aca80a7e-ac9d-4c3e-9380-627f9ee2f609 req-5d008c5b-b000-46c0-9154-49e67681cdb0 service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-aca80a7e-ac9d-4c3e-9380-627f9ee2f609 req-5d008c5b-b000-46c0-9154-49e67681cdb0 service nova] Lock "dcc5ff42-cf38-476d-824a-0391edd98604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:27:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-aca80a7e-ac9d-4c3e-9380-627f9ee2f609 req-5d008c5b-b000-46c0-9154-49e67681cdb0 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] No waiting events found dispatching network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:27:41 user nova-compute[74261]: WARNING nova.compute.manager [req-aca80a7e-ac9d-4c3e-9380-627f9ee2f609 req-5d008c5b-b000-46c0-9154-49e67681cdb0 service nova] [instance: dcc5ff42-cf38-476d-824a-0391edd98604] Received unexpected event network-vif-plugged-f9dc61b1-cc85-461c-8f5b-5bba21b2035f for instance with vm_state deleted and task_state None.
Oct 17 12:27:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:27:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:27:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:27:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:28:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:28:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:28:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:28:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:28:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:28:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:28:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:28:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:28:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:32 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:33 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:28:39 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:28:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.147998809814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 568bee30-c334-49bf-819c-b052d50ea84a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:28:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:28:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-changed-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Refreshing instance network info cache due to event network-changed-b3e545e7-9dc0-46cb-9107-6a45df48165d. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] Acquiring lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] Acquired lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.network.neutron [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Refreshing network info cache for port b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:47 user nova-compute[74261]: INFO nova.compute.manager [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Terminating instance
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Skipping network cache update for instance because it is being deleted. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a47e3ee-f2b2-41f8-8517-c4ae1b034147 req-a95a06d5-0e2c-4476-ba95-88b235d31863 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-vif-unplugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a47e3ee-f2b2-41f8-8517-c4ae1b034147 req-a95a06d5-0e2c-4476-ba95-88b235d31863 service nova] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a47e3ee-f2b2-41f8-8517-c4ae1b034147 req-a95a06d5-0e2c-4476-ba95-88b235d31863 service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-1a47e3ee-f2b2-41f8-8517-c4ae1b034147 req-a95a06d5-0e2c-4476-ba95-88b235d31863 service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a47e3ee-f2b2-41f8-8517-c4ae1b034147 req-a95a06d5-0e2c-4476-ba95-88b235d31863 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] No waiting events found dispatching network-vif-unplugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:28:47 user nova-compute[74261]: DEBUG nova.compute.manager [req-1a47e3ee-f2b2-41f8-8517-c4ae1b034147 req-a95a06d5-0e2c-4476-ba95-88b235d31863 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-vif-unplugged-b3e545e7-9dc0-46cb-9107-6a45df48165d for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.network.neutron [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updated VIF entry in instance network info cache for port b3e545e7-9dc0-46cb-9107-6a45df48165d. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.network.neutron [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [{"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-779029a5-1b25-4811-b6d9-8e9cebac9498 req-324808ae-25f0-49ca-9b20-96cc77b20165 service nova] Releasing lock "refresh_cache-568bee30-c334-49bf-819c-b052d50ea84a" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Instance destroyed successfully.
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.objects.instance [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lazy-loading 'resources' on Instance uuid 568bee30-c334-49bf-819c-b052d50ea84a {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1296003645',display_name='tempest-TestStampPattern-server-1296003645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1296003645',id=45,image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuucJOW55DYiHQowqF5dsFtdYM7nDKLkdpo66szdSu6U02fRCEzcnkL/hTyVAgbHX7OrBMFxyCrQbocnpOcyDfV0WQBURWX7ZpzeU/yLVeyV8KpUsydF+v4fv2OaYgRvw==',key_name='tempest-TestStampPattern-251515459',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2344eace8044549c9df70815cfc25c',ramdisk_id='',reservation_id='r-0qnm0oy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b60d4df-2b06-4b78-b4ef-1c17d613f5c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1179693229',owner_user_name='tempest-TestStampPattern-1179693229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:24:33Z,user_data=None,user_id='37a12e23c167417db843298e75de49cb',uuid=568bee30-c334-49bf-819c-b052d50ea84a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converting VIF {"id": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "address": "fa:16:3e:cf:d7:60", "network": {"id": "562a5126-136c-43f2-9327-d28abd9c5992", "bridge": "br-int", "label": "tempest-TestStampPattern-827778324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2344eace8044549c9df70815cfc25c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e545e7-9d", "ovs_interfaceid": "b3e545e7-9dc0-46cb-9107-6a45df48165d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG os_vif [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3e545e7-9d, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdd3ee38-cc19-4d8b-9047-192ab9d3ceaf) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:28:48 user nova-compute[74261]: INFO os_vif [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=b3e545e7-9dc0-46cb-9107-6a45df48165d,network=Network(562a5126-136c-43f2-9327-d28abd9c5992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e545e7-9d')
Oct 17 12:28:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Deleting instance files /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a_del
Oct 17 12:28:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Deletion of /opt/stack/data/nova/instances/568bee30-c334-49bf-819c-b052d50ea84a_del complete
Oct 17 12:28:48 user nova-compute[74261]: INFO nova.compute.manager [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 17 12:28:48 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:28:48 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Took 0.38 seconds to deallocate network for instance.
Oct 17 12:28:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:49 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Deleted allocations for instance 568bee30-c334-49bf-819c-b052d50ea84a
Oct 17 12:28:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-acf861da-7e94-477c-b7e2-6c9c3effbcf4 tempest-TestStampPattern-1179693229 tempest-TestStampPattern-1179693229-project-member] Lock "568bee30-c334-49bf-819c-b052d50ea84a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.793s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-d143dc9f-dcbc-4b90-a242-a1c6e6b750d8 req-06a6ab14-4096-4098-9672-d42ba6908785 service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-vif-deleted-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-4d9545c0-2ac8-4d94-8b83-58d2ce45e5c2 req-8dbadb52-9807-4ab8-ab8c-313656fa5a5e service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received event network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4d9545c0-2ac8-4d94-8b83-58d2ce45e5c2 req-8dbadb52-9807-4ab8-ab8c-313656fa5a5e service nova] Acquiring lock "568bee30-c334-49bf-819c-b052d50ea84a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4d9545c0-2ac8-4d94-8b83-58d2ce45e5c2 req-8dbadb52-9807-4ab8-ab8c-313656fa5a5e service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4d9545c0-2ac8-4d94-8b83-58d2ce45e5c2 req-8dbadb52-9807-4ab8-ab8c-313656fa5a5e service nova] Lock "568bee30-c334-49bf-819c-b052d50ea84a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:28:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-4d9545c0-2ac8-4d94-8b83-58d2ce45e5c2 req-8dbadb52-9807-4ab8-ab8c-313656fa5a5e service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] No waiting events found dispatching network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:28:49 user nova-compute[74261]: WARNING nova.compute.manager [req-4d9545c0-2ac8-4d94-8b83-58d2ce45e5c2 req-8dbadb52-9807-4ab8-ab8c-313656fa5a5e service nova] [instance: 568bee30-c334-49bf-819c-b052d50ea84a] Received unexpected event network-vif-plugged-b3e545e7-9dc0-46cb-9107-6a45df48165d for instance with vm_state deleted and task_state None.
Oct 17 12:28:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:28:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:28:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:29:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:29:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:29:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:29:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:29:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:31 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:29:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:29:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:29:39 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:29:39 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9160MB free_disk=25.175155639648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:29:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:29:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:29:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:29:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:29:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:29:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:29:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:29:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "b192d660-83e5-4d8c-834a-728b6ec31424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:30:28 user nova-compute[74261]: INFO nova.compute.claims [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Claim successful on node user
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.network.neutron [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:30:28 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:30:28 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:30:29 user nova-compute[74261]: INFO nova.virt.block_device [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Booting with volume snapshot f00c069f-e20b-4f21-ba41-e4c8ae5eea58 at /dev/vda
Oct 17 12:30:29 user nova-compute[74261]: DEBUG nova.policy [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a38d9af156c42b8ad4865b983f39da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4261c4841d42488970198c3fb8fdfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:30:29 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:29 user nova-compute[74261]: DEBUG nova.network.neutron [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Successfully created port: 0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Successfully updated port: 0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquired lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-changed-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.compute.manager [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Refreshing instance network info cache due to event network-changed-0b800e15-7681-4696-b533-5b276d3217e5. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] Acquiring lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updating instance_info_cache with network_info: [{"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Releasing lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Instance network_info: |[{"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] Acquired lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Refreshing network info cache for port 0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updated VIF entry in instance network info cache for port 0b800e15-7681-4696-b533-5b276d3217e5. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG nova.network.neutron [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updating instance_info_cache with network_info: [{"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:30:30 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-64c722c0-d0df-4393-bee7-ba1e5f27665d req-84f7bbea-f7bd-4114-885e-ecaa7468f196 service nova] Releasing lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:30:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:33 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG os_brick.utils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee38a0-422d-4030-ae09-594658c3866d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1166e-f812-4427-96c2-c3a95f7641c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d19a24-6826-4680-a750-38b2fd83c00b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be190e8-9289-45dd-9f19-761ad6d0f7fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:30:34 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:30:34 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c9ad52-3162-4f39-b3ee-176693ff173a]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG os_brick.utils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:30:34 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updating existing volume attachment record: 6634b3ff-9246-4dbc-adbc-7fe5195279f0 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:30:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:30:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:30:40 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9156MB free_disk=25.164581298828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance b192d660-83e5-4d8c-834a-728b6ec31424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:30:40 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:30:41 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:30:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:30:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:30:45 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:30:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:30:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 12:30:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:30:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:30:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Creating image(s)
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Ensure instance console log exists: /opt/stack/data/nova/instances/b192d660-83e5-4d8c-834a-728b6ec31424/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Start _get_guest_xml network_info=[{"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '6634b3ff-9246-4dbc-adbc-7fe5195279f0', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKwqFNmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b192d660-83e5-4d8c-834a-728b6ec31424', 'attached_at': '', 'detached_at': '', 'volume_id': 'be1b5b36-89d4-473d-aa62-aa335691096e', 'serial': 'be1b5b36-89d4-473d-aa62-aa335691096e'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:30:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:30:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKwqFNmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:30:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:30:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:30:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:30:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:30:58 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89177bbd-e0df-4be7-bb67-73e1e9dcbd51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:30:58 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5c5e7-293f-4275-aa53-2c76f126d853]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e] added
Oct 17 12:30:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d66a1-c302-4b82-8ea2-cdfb4046b782]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd3638-7f1e-4904-9400-4d25cb7003c7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKwqFNmy {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKwqFNmy" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f516c70-63bb-4c2e-b22d-f9eed77ec3d2]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKwqFNmy'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e66fb2-9023-4e46-8840-87b6607ac76c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b36d7-efdd-4450-98f9-d53d04b93877]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:30:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:30:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:30:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:30:59 user nova-compute[74261]: 
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115b759-8358-4f28-8e92-2cd82b6e60d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260]
Oct 17 12:30:59 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260] successful.
Oct 17 12:30:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[790dde2f-4ee8-473a-9f71-3894fd058e66]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b7570-dc05-41a0-8ad4-34cc29df6a51]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e (non-flash)
Oct 17 12:30:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e (non-flash)
Oct 17 12:30:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[48771d6a-2ca9-4f3d-b2dd-9425d70a005b]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:30:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKwqFNmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23362336536393166', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362336536393166', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1261055787',display_name='tempest-TestVolumeBootPattern-server-1261055787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1261055787',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-gbzcvivv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:30:29Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=b192d660-83e5-4d8c-834a-728b6ec31424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.objects.instance [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'pci_devices' on Instance uuid b192d660-83e5-4d8c-834a-728b6ec31424 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:31:00 user nova-compute[74261]:   <uuid>b192d660-83e5-4d8c-834a-728b6ec31424</uuid>
Oct 17 12:31:00 user nova-compute[74261]:   <name>instance-0000002f</name>
Oct 17 12:31:00 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:31:00 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:31:00 user nova-compute[74261]:   <metadata>
Oct 17 12:31:00 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:31:00 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:31:00 user nova-compute[74261]:       <nova:name>tempest-TestVolumeBootPattern-server-1261055787</nova:name>
Oct 17 12:31:00 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:30:58</nova:creationTime>
Oct 17 12:31:00 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:31:00 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:31:00 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:31:00 user nova-compute[74261]:       <nova:owner>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:user uuid="4a38d9af156c42b8ad4865b983f39da2">tempest-TestVolumeBootPattern-2039737599-project-member</nova:user>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:project uuid="9e4261c4841d42488970198c3fb8fdfd">tempest-TestVolumeBootPattern-2039737599</nova:project>
Oct 17 12:31:00 user nova-compute[74261]:       </nova:owner>
Oct 17 12:31:00 user nova-compute[74261]:       <nova:ports>
Oct 17 12:31:00 user nova-compute[74261]:         <nova:port uuid="0b800e15-7681-4696-b533-5b276d3217e5">
Oct 17 12:31:00 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 12:31:00 user nova-compute[74261]:         </nova:port>
Oct 17 12:31:00 user nova-compute[74261]:       </nova:ports>
Oct 17 12:31:00 user nova-compute[74261]:     </nova:instance>
Oct 17 12:31:00 user nova-compute[74261]:   </metadata>
Oct 17 12:31:00 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:31:00 user nova-compute[74261]:     <system>
Oct 17 12:31:00 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:31:00 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:31:00 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:31:00 user nova-compute[74261]:       <entry name="serial">b192d660-83e5-4d8c-834a-728b6ec31424</entry>
Oct 17 12:31:00 user nova-compute[74261]:       <entry name="uuid">b192d660-83e5-4d8c-834a-728b6ec31424</entry>
Oct 17 12:31:00 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:31:00 user nova-compute[74261]:     </system>
Oct 17 12:31:00 user nova-compute[74261]:   </sysinfo>
Oct 17 12:31:00 user nova-compute[74261]:   <os>
Oct 17 12:31:00 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:31:00 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:31:00 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:31:00 user nova-compute[74261]:   </os>
Oct 17 12:31:00 user nova-compute[74261]:   <features>
Oct 17 12:31:00 user nova-compute[74261]:     <acpi/>
Oct 17 12:31:00 user nova-compute[74261]:     <apic/>
Oct 17 12:31:00 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:31:00 user nova-compute[74261]:   </features>
Oct 17 12:31:00 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:31:00 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:31:00 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:31:00 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:31:00 user nova-compute[74261]:   </clock>
Oct 17 12:31:00 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:31:00 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:31:00 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:31:00 user nova-compute[74261]:   </cpu>
Oct 17 12:31:00 user nova-compute[74261]:   <devices>
Oct 17 12:31:00 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:31:00 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:31:00 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 12:31:00 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:31:00 user nova-compute[74261]:       <serial>be1b5b36-89d4-473d-aa62-aa335691096e</serial>
Oct 17 12:31:00 user nova-compute[74261]:     </disk>
Oct 17 12:31:00 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:31:00 user nova-compute[74261]:       <mac address="fa:16:3e:88:6a:28"/>
Oct 17 12:31:00 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:31:00 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:31:00 user nova-compute[74261]:       <target dev="tap0b800e15-76"/>
Oct 17 12:31:00 user nova-compute[74261]:     </interface>
Oct 17 12:31:00 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:31:00 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/b192d660-83e5-4d8c-834a-728b6ec31424/console.log" append="off"/>
Oct 17 12:31:00 user nova-compute[74261]:     </serial>
Oct 17 12:31:00 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:31:00 user nova-compute[74261]:     <video>
Oct 17 12:31:00 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:31:00 user nova-compute[74261]:     </video>
Oct 17 12:31:00 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:31:00 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:31:00 user nova-compute[74261]:     </rng>
Oct 17 12:31:00 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:31:00 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:31:00 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:31:00 user nova-compute[74261]:     </memballoon>
Oct 17 12:31:00 user nova-compute[74261]:   </devices>
Oct 17 12:31:00 user nova-compute[74261]: </domain>
Oct 17 12:31:00 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1261055787',display_name='tempest-TestVolumeBootPattern-server-1261055787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1261055787',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-gbzcvivv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:30:29Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=b192d660-83e5-4d8c-834a-728b6ec31424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG os_vif [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09ede206-0b34-5ae8-9452-ef41246ddbe4', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b800e15-76, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b800e15-76, col_values=(('qos', UUID('45327572-f4c3-4055-8f6b-0cb53dcf74b9')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b800e15-76, col_values=(('external_ids', {'iface-id': '0b800e15-7681-4696-b533-5b276d3217e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:6a:28', 'vm-uuid': 'b192d660-83e5-4d8c-834a-728b6ec31424'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:00 user nova-compute[74261]: INFO os_vif [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76')
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:31:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No VIF found with MAC fa:16:3e:88:6a:28, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:31:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-2096a637-5b9e-4a55-8dd4-5dd5ad838d63 req-1ae7c8cf-4b35-426d-95db-be2c1930d205 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2096a637-5b9e-4a55-8dd4-5dd5ad838d63 req-1ae7c8cf-4b35-426d-95db-be2c1930d205 service nova] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2096a637-5b9e-4a55-8dd4-5dd5ad838d63 req-1ae7c8cf-4b35-426d-95db-be2c1930d205 service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2096a637-5b9e-4a55-8dd4-5dd5ad838d63 req-1ae7c8cf-4b35-426d-95db-be2c1930d205 service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-2096a637-5b9e-4a55-8dd4-5dd5ad838d63 req-1ae7c8cf-4b35-426d-95db-be2c1930d205 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] No waiting events found dispatching network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:31:02 user nova-compute[74261]: WARNING nova.compute.manager [req-2096a637-5b9e-4a55-8dd4-5dd5ad838d63 req-1ae7c8cf-4b35-426d-95db-be2c1930d205 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received unexpected event network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 for instance with vm_state building and task_state spawning.
Oct 17 12:31:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:31:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Instance spawned successfully.
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:31:03 user nova-compute[74261]: INFO nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Took 4.78 seconds to spawn the instance on the hypervisor.
Oct 17 12:31:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:31:03 user nova-compute[74261]: INFO nova.compute.manager [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Took 35.14 seconds to build instance.
Oct 17 12:31:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-31980ee1-b6f7-4b7e-8a03-e43f3948b80b tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "b192d660-83e5-4d8c-834a-728b6ec31424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.235s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:31:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-6fa5e61a-51e1-465a-8bb3-45d203623b13 req-e0f3127a-962b-4c14-86b1-8d4c7913f1bc service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:31:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6fa5e61a-51e1-465a-8bb3-45d203623b13 req-e0f3127a-962b-4c14-86b1-8d4c7913f1bc service nova] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:31:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6fa5e61a-51e1-465a-8bb3-45d203623b13 req-e0f3127a-962b-4c14-86b1-8d4c7913f1bc service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:31:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6fa5e61a-51e1-465a-8bb3-45d203623b13 req-e0f3127a-962b-4c14-86b1-8d4c7913f1bc service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:31:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-6fa5e61a-51e1-465a-8bb3-45d203623b13 req-e0f3127a-962b-4c14-86b1-8d4c7913f1bc service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] No waiting events found dispatching network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:31:04 user nova-compute[74261]: WARNING nova.compute.manager [req-6fa5e61a-51e1-465a-8bb3-45d203623b13 req-e0f3127a-962b-4c14-86b1-8d4c7913f1bc service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received unexpected event network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 for instance with vm_state active and task_state None.
Oct 17 12:31:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:31:05 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:31:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:31:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:31:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:31:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:31:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:31:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:33 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Triggering sync for uuid b192d660-83e5-4d8c-834a-728b6ec31424 {{(pid=74261) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "b192d660-83e5-4d8c-834a-728b6ec31424" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:31:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "b192d660-83e5-4d8c-834a-728b6ec31424" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:31:41 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:31:41 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:31:41 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.163204193115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:31:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance b192d660-83e5-4d8c-834a-728b6ec31424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:31:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:31:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:31:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:31:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:31:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:31:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid b192d660-83e5-4d8c-834a-728b6ec31424 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updating instance_info_cache with network_info: [{"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-b192d660-83e5-4d8c-834a-728b6ec31424" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:31:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:31:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:31:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:31:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:31:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:31:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:31:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:32:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:32:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:32:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:32:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "b192d660-83e5-4d8c-834a-728b6ec31424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:19 user nova-compute[74261]: INFO nova.compute.manager [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Terminating instance
Oct 17 12:32:19 user nova-compute[74261]: DEBUG nova.compute.manager [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c922910-fc38-4c20-bfac-a7566a7e1802 req-3c02ecd8-dc0f-435d-9d4b-540383c9c665 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-vif-unplugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c922910-fc38-4c20-bfac-a7566a7e1802 req-3c02ecd8-dc0f-435d-9d4b-540383c9c665 service nova] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c922910-fc38-4c20-bfac-a7566a7e1802 req-3c02ecd8-dc0f-435d-9d4b-540383c9c665 service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9c922910-fc38-4c20-bfac-a7566a7e1802 req-3c02ecd8-dc0f-435d-9d4b-540383c9c665 service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c922910-fc38-4c20-bfac-a7566a7e1802 req-3c02ecd8-dc0f-435d-9d4b-540383c9c665 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] No waiting events found dispatching network-vif-unplugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG nova.compute.manager [req-9c922910-fc38-4c20-bfac-a7566a7e1802 req-3c02ecd8-dc0f-435d-9d4b-540383c9c665 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-vif-unplugged-0b800e15-7681-4696-b533-5b276d3217e5 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:32:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:20 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Instance destroyed successfully.
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.objects.instance [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'resources' on Instance uuid b192d660-83e5-4d8c-834a-728b6ec31424 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1261055787',display_name='tempest-TestVolumeBootPattern-server-1261055787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1261055787',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-gbzcvivv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:31:04Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=b192d660-83e5-4d8c-834a-728b6ec31424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "0b800e15-7681-4696-b533-5b276d3217e5", "address": "fa:16:3e:88:6a:28", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b800e15-76", "ovs_interfaceid": "0b800e15-7681-4696-b533-5b276d3217e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_vif [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b800e15-76, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45327572-f4c3-4055-8f6b-0cb53dcf74b9) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:20 user nova-compute[74261]: INFO os_vif [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:6a:28,bridge_name='br-int',has_traffic_filtering=True,id=0b800e15-7681-4696-b533-5b276d3217e5,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b800e15-76')
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKwqFNmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:32:20 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f536ba14-f0c1-4527-be45-3196fbc3f29e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:32:20 user nova-compute[74261]: No targets found.
Oct 17 12:32:20 user nova-compute[74261]: iSNS:
Oct 17 12:32:20 user nova-compute[74261]: No targets found.
Oct 17 12:32:20 user nova-compute[74261]: STATIC:
Oct 17 12:32:20 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e
Oct 17 12:32:20 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:32:20 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:32:20 user nova-compute[74261]: FIRMWARE:
Oct 17 12:32:20 user nova-compute[74261]: No targets found.
Oct 17 12:32:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:32:20 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:32:20 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[755480ce-0806-43d8-93df-a1c2d853c628]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56ba79-2564-459d-8608-e1334b6343c5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e (non-flash)
Oct 17 12:32:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e (non-flash)
Oct 17 12:32:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b24117eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912a7bb-046f-4778-90b8-741ce93c2e13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa2e12-cb38-4a56-b95b-b6fa9fdf56be]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1a655-f538-4f4c-8d64-f720c8e0a88c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6490faab-1781-4325-a5d3-9a53318dd18a]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23362336536393166', '/dev/disk/by-id/scsi-1SCST_BIO998c2f58-3b3e691f07329da2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_998c2f58') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de327ed-6adc-441e-9ecc-c19969cb5492]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd1bad-f7ef-44c7-81f7-8d3db0a8e646]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172302e-f207-4118-9a9e-cffa28cba546]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260]
Oct 17 12:32:20 user nova-compute[74261]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e, portal: 172.16.0.220,3260] successful.
Oct 17 12:32:20 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1b5b36-89d4-473d-aa62-aa335691096e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[937e2266-7573-416e-80b6-7f8450b5f772]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== disconnect_volume: return (274ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:32:20 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Deleting instance files /opt/stack/data/nova/instances/b192d660-83e5-4d8c-834a-728b6ec31424_del
Oct 17 12:32:20 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Deletion of /opt/stack/data/nova/instances/b192d660-83e5-4d8c-834a-728b6ec31424_del complete
Oct 17 12:32:20 user nova-compute[74261]: INFO nova.compute.manager [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 17 12:32:20 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:32:20 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Took 0.37 seconds to deallocate network for instance.
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-16061016-c10d-46d3-8e82-5b1d17309db2 req-5ad1e3e5-290f-4756-bd0b-6c2a61a69df0 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-vif-deleted-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:32:20 user nova-compute[74261]: INFO nova.compute.manager [req-16061016-c10d-46d3-8e82-5b1d17309db2 req-5ad1e3e5-290f-4756-bd0b-6c2a61a69df0 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Neutron deleted interface 0b800e15-7681-4696-b533-5b276d3217e5; detaching it from the instance and deleting it from the info cache
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.network.neutron [req-16061016-c10d-46d3-8e82-5b1d17309db2 req-5ad1e3e5-290f-4756-bd0b-6c2a61a69df0 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:32:20 user nova-compute[74261]: DEBUG nova.compute.manager [req-16061016-c10d-46d3-8e82-5b1d17309db2 req-5ad1e3e5-290f-4756-bd0b-6c2a61a69df0 service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Detach interface failed, port_id=0b800e15-7681-4696-b533-5b276d3217e5, reason: Instance b192d660-83e5-4d8c-834a-728b6ec31424 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:32:21 user nova-compute[74261]: INFO nova.compute.manager [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Took 0.78 seconds to detach 1 volumes for instance.
Oct 17 12:32:21 user nova-compute[74261]: DEBUG nova.compute.manager [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Deleting volume: be1b5b36-89d4-473d-aa62-aa335691096e {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-a610d6ea-574e-477c-89ee-b9313bef0803 req-e5a38870-79cb-40fa-924f-31bcf08dd3bf service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received event network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a610d6ea-574e-477c-89ee-b9313bef0803 req-e5a38870-79cb-40fa-924f-31bcf08dd3bf service nova] Acquiring lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a610d6ea-574e-477c-89ee-b9313bef0803 req-e5a38870-79cb-40fa-924f-31bcf08dd3bf service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-a610d6ea-574e-477c-89ee-b9313bef0803 req-e5a38870-79cb-40fa-924f-31bcf08dd3bf service nova] Lock "b192d660-83e5-4d8c-834a-728b6ec31424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG nova.compute.manager [req-a610d6ea-574e-477c-89ee-b9313bef0803 req-e5a38870-79cb-40fa-924f-31bcf08dd3bf service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] No waiting events found dispatching network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:32:21 user nova-compute[74261]: WARNING nova.compute.manager [req-a610d6ea-574e-477c-89ee-b9313bef0803 req-e5a38870-79cb-40fa-924f-31bcf08dd3bf service nova] [instance: b192d660-83e5-4d8c-834a-728b6ec31424] Received unexpected event network-vif-plugged-0b800e15-7681-4696-b533-5b276d3217e5 for instance with vm_state active and task_state deleting.
Oct 17 12:32:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:32:21 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:21 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Deleted allocations for instance b192d660-83e5-4d8c-834a-728b6ec31424
Oct 17 12:32:22 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-068322a7-f7e8-445d-a013-400e625828ea tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "b192d660-83e5-4d8c-834a-728b6ec31424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.661s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:32:42 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:32:42 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9140MB free_disk=25.162395477294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:32:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:32:43 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:32:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:32:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:32:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:32:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:32:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:32:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:32:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:32:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:32:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:32:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:32:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:33:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:33:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:33:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:33:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:33:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:33:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:33:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:36 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:33:43 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:33:43 user nova-compute[74261]: INFO nova.compute.claims [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Claim successful on node user
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:33:44 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.policy [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a38d9af156c42b8ad4865b983f39da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4261c4841d42488970198c3fb8fdfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:33:44 user nova-compute[74261]: INFO nova.virt.block_device [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Booting with volume 9f27c6b3-7994-481b-97fd-9a887a1eed0d at /dev/vda
Oct 17 12:33:44 user nova-compute[74261]: DEBUG os_brick.utils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5b4a3b-1051-4fa7-a38c-0fadbd9779c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5648e5e9-06ac-41cd-8df9-37db49707a6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd07ab-a11b-4412-9948-9a8226715dd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ced97-7b0a-45b2-813d-d3a4c14f122f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:33:44 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf1e7f-2ba8-4ec9-a00b-4798265a8445]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG os_brick.utils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating existing volume attachment record: 501486b4-3aae-4661-ac7e-be667b2ebeae {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Successfully created port: be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:33:44 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:33:44 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:33:44 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=25.161121368408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:33:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Successfully updated port: be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquired lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-changed-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.compute.manager [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Refreshing instance network info cache due to event network-changed-be8ba1c5-39bf-41ca-a78e-cfb1425dc056. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] Acquiring lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:33:45 user nova-compute[74261]: DEBUG nova.network.neutron [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG nova.network.neutron [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Releasing lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Instance network_info: |[{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] Acquired lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG nova.network.neutron [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Refreshing network info cache for port be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG nova.network.neutron [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updated VIF entry in instance network info cache for port be8ba1c5-39bf-41ca-a78e-cfb1425dc056. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG nova.network.neutron [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:33:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-152c9e00-b4e4-443f-8846-28fa9a358ff2 req-7ea2d6cc-0002-47de-bfc5-74287032090f service nova] Releasing lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:33:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:33:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:33:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:33:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 12:33:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:33:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:33:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:33:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:33:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:33:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:33:59 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Creating image(s)
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Ensure instance console log exists: /opt/stack/data/nova/instances/8c152f52-62d4-45ae-b3f5-0c6bf1aaf215/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Start _get_guest_xml network_info=[{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '501486b4-3aae-4661-ac7e-be667b2ebeae', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQNUXsyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c152f52-62d4-45ae-b3f5-0c6bf1aaf215', 'attached_at': '', 'detached_at': '', 'volume_id': '9f27c6b3-7994-481b-97fd-9a887a1eed0d', 'serial': '9f27c6b3-7994-481b-97fd-9a887a1eed0d'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:33:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:33:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQNUXsyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:33:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:33:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:33:59 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1d98ff-731c-4de1-8711-3b393fc349ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:33:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9cee48-25e9-4e41-9504-3558cd2dcf4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d] added
Oct 17 12:33:59 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9538c21-f458-4f89-94ac-2a72e7213a25]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[13558253-118d-40c6-9eb5-d2b0ddc2d703]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zQNUXsyd {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zQNUXsyd" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4422b33-65b5-493c-84ae-2ed5c26b7fba]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zQNUXsyd'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edfe157-0965-4470-b289-d7dfe4be7070]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.033s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59168d84-47cc-49c3-b53f-fbeff74777fd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:33:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:33:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:33:59 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:33:59 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:33:59 user nova-compute[74261]: 
Oct 17 12:33:59 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[458064e2-21c5-484e-afc7-1d8eacee0439]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260]
Oct 17 12:34:00 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260] successful.
Oct 17 12:34:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd3afe-eb07-4e55-bee4-ba409eee9bf9]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c1495e-fd02-4f3a-9c15-0ba385a299ce]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:34:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:34:00 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f4bfee-2f9c-4007-9835-b112c1bfcc4a]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQNUXsyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:34:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23733336337326439', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733336337326439', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-34600185',display_name='tempest-TestVolumeBootPattern-volume-backed-server-34600185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-34600185',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcO2hKIZLFUT6kzLtX2vDM1JWacYRP0BYDaLz2lxUHkzxyIuBnw+FLul6wWXYsmGosLm4ZKbRLP/g6ZtEJAvtrwzH3E0cgmP87pTIKMBt4u8ADBfi+W293PVLc9XrjmSQ==',key_name='tempest-keypair-1630778731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-vob6s9wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=8c152f52-62d4-45ae-b3f5-0c6bf1aaf215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.objects.instance [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:34:01 user nova-compute[74261]:   <uuid>8c152f52-62d4-45ae-b3f5-0c6bf1aaf215</uuid>
Oct 17 12:34:01 user nova-compute[74261]:   <name>instance-00000030</name>
Oct 17 12:34:01 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:34:01 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:34:01 user nova-compute[74261]:   <metadata>
Oct 17 12:34:01 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:34:01 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:34:01 user nova-compute[74261]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-34600185</nova:name>
Oct 17 12:34:01 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:33:59</nova:creationTime>
Oct 17 12:34:01 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:34:01 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:34:01 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:34:01 user nova-compute[74261]:       <nova:owner>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:user uuid="4a38d9af156c42b8ad4865b983f39da2">tempest-TestVolumeBootPattern-2039737599-project-member</nova:user>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:project uuid="9e4261c4841d42488970198c3fb8fdfd">tempest-TestVolumeBootPattern-2039737599</nova:project>
Oct 17 12:34:01 user nova-compute[74261]:       </nova:owner>
Oct 17 12:34:01 user nova-compute[74261]:       <nova:ports>
Oct 17 12:34:01 user nova-compute[74261]:         <nova:port uuid="be8ba1c5-39bf-41ca-a78e-cfb1425dc056">
Oct 17 12:34:01 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 12:34:01 user nova-compute[74261]:         </nova:port>
Oct 17 12:34:01 user nova-compute[74261]:       </nova:ports>
Oct 17 12:34:01 user nova-compute[74261]:     </nova:instance>
Oct 17 12:34:01 user nova-compute[74261]:   </metadata>
Oct 17 12:34:01 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:34:01 user nova-compute[74261]:     <system>
Oct 17 12:34:01 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:34:01 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:34:01 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:34:01 user nova-compute[74261]:       <entry name="serial">8c152f52-62d4-45ae-b3f5-0c6bf1aaf215</entry>
Oct 17 12:34:01 user nova-compute[74261]:       <entry name="uuid">8c152f52-62d4-45ae-b3f5-0c6bf1aaf215</entry>
Oct 17 12:34:01 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:34:01 user nova-compute[74261]:     </system>
Oct 17 12:34:01 user nova-compute[74261]:   </sysinfo>
Oct 17 12:34:01 user nova-compute[74261]:   <os>
Oct 17 12:34:01 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:34:01 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:34:01 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:34:01 user nova-compute[74261]:   </os>
Oct 17 12:34:01 user nova-compute[74261]:   <features>
Oct 17 12:34:01 user nova-compute[74261]:     <acpi/>
Oct 17 12:34:01 user nova-compute[74261]:     <apic/>
Oct 17 12:34:01 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:34:01 user nova-compute[74261]:   </features>
Oct 17 12:34:01 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:34:01 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:34:01 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:34:01 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:34:01 user nova-compute[74261]:   </clock>
Oct 17 12:34:01 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:34:01 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:34:01 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:34:01 user nova-compute[74261]:   </cpu>
Oct 17 12:34:01 user nova-compute[74261]:   <devices>
Oct 17 12:34:01 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:34:01 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:34:01 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 12:34:01 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:34:01 user nova-compute[74261]:       <serial>9f27c6b3-7994-481b-97fd-9a887a1eed0d</serial>
Oct 17 12:34:01 user nova-compute[74261]:     </disk>
Oct 17 12:34:01 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:34:01 user nova-compute[74261]:       <mac address="fa:16:3e:f4:4f:8f"/>
Oct 17 12:34:01 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:34:01 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:34:01 user nova-compute[74261]:       <target dev="tapbe8ba1c5-39"/>
Oct 17 12:34:01 user nova-compute[74261]:     </interface>
Oct 17 12:34:01 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:34:01 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/8c152f52-62d4-45ae-b3f5-0c6bf1aaf215/console.log" append="off"/>
Oct 17 12:34:01 user nova-compute[74261]:     </serial>
Oct 17 12:34:01 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:34:01 user nova-compute[74261]:     <video>
Oct 17 12:34:01 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:34:01 user nova-compute[74261]:     </video>
Oct 17 12:34:01 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:34:01 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:34:01 user nova-compute[74261]:     </rng>
Oct 17 12:34:01 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:34:01 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:34:01 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:34:01 user nova-compute[74261]:     </memballoon>
Oct 17 12:34:01 user nova-compute[74261]:   </devices>
Oct 17 12:34:01 user nova-compute[74261]: </domain>
Oct 17 12:34:01 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-34600185',display_name='tempest-TestVolumeBootPattern-volume-backed-server-34600185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-34600185',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcO2hKIZLFUT6kzLtX2vDM1JWacYRP0BYDaLz2lxUHkzxyIuBnw+FLul6wWXYsmGosLm4ZKbRLP/g6ZtEJAvtrwzH3E0cgmP87pTIKMBt4u8ADBfi+W293PVLc9XrjmSQ==',key_name='tempest-keypair-1630778731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-vob6s9wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=8c152f52-62d4-45ae-b3f5-0c6bf1aaf215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG os_vif [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afa937ec-5396-50f6-8973-49eb55f8fa3d', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe8ba1c5-39, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe8ba1c5-39, col_values=(('qos', UUID('80cc821a-73f7-4a04-ad17-90e9e9eb4950')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe8ba1c5-39, col_values=(('external_ids', {'iface-id': 'be8ba1c5-39bf-41ca-a78e-cfb1425dc056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:4f:8f', 'vm-uuid': '8c152f52-62d4-45ae-b3f5-0c6bf1aaf215'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:01 user nova-compute[74261]: INFO os_vif [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39')
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:34:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No VIF found with MAC fa:16:3e:f4:4f:8f, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-33267f77-1d35-473a-9556-49a3adaaa51f req-b0e46a33-a572-497f-828c-56198f8fd05b service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33267f77-1d35-473a-9556-49a3adaaa51f req-b0e46a33-a572-497f-828c-56198f8fd05b service nova] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33267f77-1d35-473a-9556-49a3adaaa51f req-b0e46a33-a572-497f-828c-56198f8fd05b service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-33267f77-1d35-473a-9556-49a3adaaa51f req-b0e46a33-a572-497f-828c-56198f8fd05b service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:34:02 user nova-compute[74261]: DEBUG nova.compute.manager [req-33267f77-1d35-473a-9556-49a3adaaa51f req-b0e46a33-a572-497f-828c-56198f8fd05b service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] No waiting events found dispatching network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:34:02 user nova-compute[74261]: WARNING nova.compute.manager [req-33267f77-1d35-473a-9556-49a3adaaa51f req-b0e46a33-a572-497f-828c-56198f8fd05b service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received unexpected event network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 for instance with vm_state building and task_state spawning.
Oct 17 12:34:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:34:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Instance spawned successfully.
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:34:04 user nova-compute[74261]: INFO nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Took 4.91 seconds to spawn the instance on the hypervisor.
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-8cffe244-ed92-4c0d-b5f7-6db3b85083c2 req-056a3519-f1e5-4e69-8231-c29e7bd91a06 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8cffe244-ed92-4c0d-b5f7-6db3b85083c2 req-056a3519-f1e5-4e69-8231-c29e7bd91a06 service nova] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8cffe244-ed92-4c0d-b5f7-6db3b85083c2 req-056a3519-f1e5-4e69-8231-c29e7bd91a06 service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8cffe244-ed92-4c0d-b5f7-6db3b85083c2 req-056a3519-f1e5-4e69-8231-c29e7bd91a06 service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:34:04 user nova-compute[74261]: DEBUG nova.compute.manager [req-8cffe244-ed92-4c0d-b5f7-6db3b85083c2 req-056a3519-f1e5-4e69-8231-c29e7bd91a06 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] No waiting events found dispatching network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:34:04 user nova-compute[74261]: WARNING nova.compute.manager [req-8cffe244-ed92-4c0d-b5f7-6db3b85083c2 req-056a3519-f1e5-4e69-8231-c29e7bd91a06 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received unexpected event network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 for instance with vm_state building and task_state spawning.
Oct 17 12:34:04 user nova-compute[74261]: INFO nova.compute.manager [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Took 20.91 seconds to build instance.
Oct 17 12:34:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-572e22d8-f1da-4c62-926f-abee4c12ff7f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.998s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:34:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:43 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:34:46 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:34:46 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:34:46 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.159603118896484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:34:46 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:34:47 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:34:47 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:34:47 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:34:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:34:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:34:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:34:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:35:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:35:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:16 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:35:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:35:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:35:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:35:21 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:26 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:31 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-changed-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Refreshing instance network info cache due to event network-changed-be8ba1c5-39bf-41ca-a78e-cfb1425dc056. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] Acquiring lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] Acquired lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Refreshing network info cache for port be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updated VIF entry in instance network info cache for port be8ba1c5-39bf-41ca-a78e-cfb1425dc056. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:35:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2f42ac4b-c2af-473e-a395-dcab6b863140 req-37e8bb40-b2c3-4d1c-8f96-035a2b99089e service nova] Releasing lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:35:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:35:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:35:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:35:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:35:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:35:36 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:35:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:46 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:35:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:35:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:35:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:35:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:35:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:35:47 user nova-compute[74261]: INFO nova.compute.claims [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Claim successful on node user
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:35:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:35:48 user nova-compute[74261]: INFO nova.virt.block_device [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Booting with volume snapshot 6c0c8896-efd3-493f-a59f-575f666bff7d at /dev/vda
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.policy [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a38d9af156c42b8ad4865b983f39da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4261c4841d42488970198c3fb8fdfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:35:48 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:35:48 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.158550262451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:35:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Successfully created port: dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 91c3c273-792c-4240-9e0b-05596f3b78b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Successfully updated port: dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquired lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:35:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-changed-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.compute.manager [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Refreshing instance network info cache due to event network-changed-dae27883-272e-4901-bb2f-949665dea6e8. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] Acquiring lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.network.neutron [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updating instance_info_cache with network_info: [{"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Releasing lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Instance network_info: |[{"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] Acquired lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Refreshing network info cache for port dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updated VIF entry in instance network info cache for port dae27883-272e-4901-bb2f-949665dea6e8. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updating instance_info_cache with network_info: [{"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:35:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-14360456-a1f3-48bb-ae20-f13400f3a2ff req-3f648272-de00-48b3-9764-2596176233ef service nova] Releasing lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:35:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:35:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG os_brick.utils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[da090a57-affb-4528-b5fc-c4dd709a5eea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[63511c92-0b47-4cbd-9beb-e425ee1e3c58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58c63a4-dfae-44d0-9b13-e0e095a2d194]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[420ed7e3-4277-4d28-844f-83d5bf9b48d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:35:54 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:35:54 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a881ba21-2a80-476b-824a-9cb671f97cb0]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG os_brick.utils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:35:54 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updating existing volume attachment record: d9f36128-f777-44ee-91c3-5eee96219daa {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:35:56 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:36:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:36:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:07 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:36:07 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:36:10 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Creating image(s)
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Ensure instance console log exists: /opt/stack/data/nova/instances/91c3c273-792c-4240-9e0b-05596f3b78b1/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Start _get_guest_xml network_info=[{"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-17T12:35:37Z,direct_url=<?>,disk_format='qcow2',id=a566d080-739e-41cc-bd5c-667b2c034e7f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-46427784',owner='9e4261c4841d42488970198c3fb8fdfd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-17T12:35:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'd9f36128-f777-44ee-91c3-5eee96219daa', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzEgIPOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '91c3c273-792c-4240-9e0b-05596f3b78b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f37e3081-6bd6-44b2-9468-324d26faa724', 'serial': 'f37e3081-6bd6-44b2-9468-324d26faa724'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:36:10 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:36:10 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-17T12:35:37Z,direct_url=<?>,disk_format='qcow2',id=a566d080-739e-41cc-bd5c-667b2c034e7f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-46427784',owner='9e4261c4841d42488970198c3fb8fdfd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-17T12:35:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzEgIPOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:36:10 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:36:10 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:36:10 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6cf80-4eb9-4040-a393-8b42d5f9a69c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:36:10 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e441f-7e78-4e29-8487-fdc01bd94a4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724] added
Oct 17 12:36:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4556ce-6876-4ade-9292-5b966f553a8b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca4d1cb-7911-4986-b531-e9e73b551031]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzEgIPOw {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzEgIPOw" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2f2031-b209-454a-8969-891d7282f359]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XzEgIPOw'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d798c70f-e4e1-42d9-aa90-955a7e70bf20]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed94a54-dfb6-4628-95a0-5efebff9c539]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:36:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:36:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0556ba9-219a-46c9-880f-10e5e27d2b76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260]
Oct 17 12:36:10 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260] successful.
Oct 17 12:36:10 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:10 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f11996-a27c-48d2-a81d-6ba109872e2c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e50049-1661-46d8-a2d6-3aaed20aeff3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:36:11 user nova-compute[74261]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 (non-flash)
Oct 17 12:36:11 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:36:11 user nova-compute[74261]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 (non-flash)
Oct 17 12:36:11 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c8b886-7069-46dd-b52a-f81e1f68a035]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:36:11 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzEgIPOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23431366362316361', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431366362316361', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-536481284',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-536481284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-536481284',id=49,image_ref='a566d080-739e-41cc-bd5c-667b2c034e7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvqnzo45ZE8uqdSY7T9YqXC6S14HFsocaqJTApyRDHg93Mk34CwTte+G0JIegzYP19qIhUclyMIaPFXuHmZR5j/3rs0SFfCoqI9MTShbk17TgaPso1/vLckqPJXASluIw==',key_name='tempest-keypair-1685769046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-ohh9gfnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2039737599',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:35:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=91c3c273-792c-4240-9e0b-05596f3b78b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.objects.instance [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'pci_devices' on Instance uuid 91c3c273-792c-4240-9e0b-05596f3b78b1 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:36:12 user nova-compute[74261]:   <uuid>91c3c273-792c-4240-9e0b-05596f3b78b1</uuid>
Oct 17 12:36:12 user nova-compute[74261]:   <name>instance-00000031</name>
Oct 17 12:36:12 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:36:12 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:36:12 user nova-compute[74261]:   <metadata>
Oct 17 12:36:12 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:36:12 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:36:12 user nova-compute[74261]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-536481284</nova:name>
Oct 17 12:36:12 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:36:10</nova:creationTime>
Oct 17 12:36:12 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:36:12 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:36:12 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:36:12 user nova-compute[74261]:       <nova:owner>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:user uuid="4a38d9af156c42b8ad4865b983f39da2">tempest-TestVolumeBootPattern-2039737599-project-member</nova:user>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:project uuid="9e4261c4841d42488970198c3fb8fdfd">tempest-TestVolumeBootPattern-2039737599</nova:project>
Oct 17 12:36:12 user nova-compute[74261]:       </nova:owner>
Oct 17 12:36:12 user nova-compute[74261]:       <nova:root type="image" uuid="a566d080-739e-41cc-bd5c-667b2c034e7f"/>
Oct 17 12:36:12 user nova-compute[74261]:       <nova:ports>
Oct 17 12:36:12 user nova-compute[74261]:         <nova:port uuid="dae27883-272e-4901-bb2f-949665dea6e8">
Oct 17 12:36:12 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 12:36:12 user nova-compute[74261]:         </nova:port>
Oct 17 12:36:12 user nova-compute[74261]:       </nova:ports>
Oct 17 12:36:12 user nova-compute[74261]:     </nova:instance>
Oct 17 12:36:12 user nova-compute[74261]:   </metadata>
Oct 17 12:36:12 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:36:12 user nova-compute[74261]:     <system>
Oct 17 12:36:12 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:36:12 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:36:12 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:36:12 user nova-compute[74261]:       <entry name="serial">91c3c273-792c-4240-9e0b-05596f3b78b1</entry>
Oct 17 12:36:12 user nova-compute[74261]:       <entry name="uuid">91c3c273-792c-4240-9e0b-05596f3b78b1</entry>
Oct 17 12:36:12 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:36:12 user nova-compute[74261]:     </system>
Oct 17 12:36:12 user nova-compute[74261]:   </sysinfo>
Oct 17 12:36:12 user nova-compute[74261]:   <os>
Oct 17 12:36:12 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:36:12 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:36:12 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:36:12 user nova-compute[74261]:   </os>
Oct 17 12:36:12 user nova-compute[74261]:   <features>
Oct 17 12:36:12 user nova-compute[74261]:     <acpi/>
Oct 17 12:36:12 user nova-compute[74261]:     <apic/>
Oct 17 12:36:12 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:36:12 user nova-compute[74261]:   </features>
Oct 17 12:36:12 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:36:12 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:36:12 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:36:12 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:36:12 user nova-compute[74261]:   </clock>
Oct 17 12:36:12 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:36:12 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:36:12 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:36:12 user nova-compute[74261]:   </cpu>
Oct 17 12:36:12 user nova-compute[74261]:   <devices>
Oct 17 12:36:12 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:36:12 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:36:12 user nova-compute[74261]:       <source dev="/dev/sdc"/>
Oct 17 12:36:12 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:36:12 user nova-compute[74261]:       <serial>f37e3081-6bd6-44b2-9468-324d26faa724</serial>
Oct 17 12:36:12 user nova-compute[74261]:     </disk>
Oct 17 12:36:12 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:36:12 user nova-compute[74261]:       <mac address="fa:16:3e:27:92:38"/>
Oct 17 12:36:12 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:36:12 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:36:12 user nova-compute[74261]:       <target dev="tapdae27883-27"/>
Oct 17 12:36:12 user nova-compute[74261]:     </interface>
Oct 17 12:36:12 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:36:12 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/91c3c273-792c-4240-9e0b-05596f3b78b1/console.log" append="off"/>
Oct 17 12:36:12 user nova-compute[74261]:     </serial>
Oct 17 12:36:12 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:36:12 user nova-compute[74261]:     <video>
Oct 17 12:36:12 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:36:12 user nova-compute[74261]:     </video>
Oct 17 12:36:12 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:36:12 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:36:12 user nova-compute[74261]:     </rng>
Oct 17 12:36:12 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:36:12 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:36:12 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:36:12 user nova-compute[74261]:     </memballoon>
Oct 17 12:36:12 user nova-compute[74261]:   </devices>
Oct 17 12:36:12 user nova-compute[74261]: </domain>
Oct 17 12:36:12 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-536481284',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-536481284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-536481284',id=49,image_ref='a566d080-739e-41cc-bd5c-667b2c034e7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvqnzo45ZE8uqdSY7T9YqXC6S14HFsocaqJTApyRDHg93Mk34CwTte+G0JIegzYP19qIhUclyMIaPFXuHmZR5j/3rs0SFfCoqI9MTShbk17TgaPso1/vLckqPJXASluIw==',key_name='tempest-keypair-1685769046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-ohh9gfnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2039737599',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:35:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=91c3c273-792c-4240-9e0b-05596f3b78b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG os_vif [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b97af8f-01fb-568c-becd-eddd24b83f4e', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdae27883-27, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdae27883-27, col_values=(('qos', UUID('48451c87-4aea-446a-97c0-bd03c52dcc86')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdae27883-27, col_values=(('external_ids', {'iface-id': 'dae27883-272e-4901-bb2f-949665dea6e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:92:38', 'vm-uuid': '91c3c273-792c-4240-9e0b-05596f3b78b1'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:12 user nova-compute[74261]: INFO os_vif [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27')
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No VIF found with MAC fa:16:3e:27:92:38, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:12 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-d3273acb-8861-4ab1-8f07-e4c8b40d0a4d req-73d5399f-1f77-4688-a248-93379327bf22 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d3273acb-8861-4ab1-8f07-e4c8b40d0a4d req-73d5399f-1f77-4688-a248-93379327bf22 service nova] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d3273acb-8861-4ab1-8f07-e4c8b40d0a4d req-73d5399f-1f77-4688-a248-93379327bf22 service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d3273acb-8861-4ab1-8f07-e4c8b40d0a4d req-73d5399f-1f77-4688-a248-93379327bf22 service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:36:13 user nova-compute[74261]: DEBUG nova.compute.manager [req-d3273acb-8861-4ab1-8f07-e4c8b40d0a4d req-73d5399f-1f77-4688-a248-93379327bf22 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] No waiting events found dispatching network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:36:13 user nova-compute[74261]: WARNING nova.compute.manager [req-d3273acb-8861-4ab1-8f07-e4c8b40d0a4d req-73d5399f-1f77-4688-a248-93379327bf22 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received unexpected event network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 for instance with vm_state building and task_state spawning.
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:36:15 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Instance spawned successfully.
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:36:15 user nova-compute[74261]: INFO nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:36:15 user nova-compute[74261]: INFO nova.compute.manager [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Took 27.78 seconds to build instance.
Oct 17 12:36:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-f0ee89c9-45e7-406c-b565-d64611777135 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.881s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-0ebf956d-f973-4b1c-aa07-85f4cc012086 req-6ddc042c-f47d-4c77-86a7-fe9ce30884a5 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0ebf956d-f973-4b1c-aa07-85f4cc012086 req-6ddc042c-f47d-4c77-86a7-fe9ce30884a5 service nova] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0ebf956d-f973-4b1c-aa07-85f4cc012086 req-6ddc042c-f47d-4c77-86a7-fe9ce30884a5 service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-0ebf956d-f973-4b1c-aa07-85f4cc012086 req-6ddc042c-f47d-4c77-86a7-fe9ce30884a5 service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:36:15 user nova-compute[74261]: DEBUG nova.compute.manager [req-0ebf956d-f973-4b1c-aa07-85f4cc012086 req-6ddc042c-f47d-4c77-86a7-fe9ce30884a5 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] No waiting events found dispatching network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:36:15 user nova-compute[74261]: WARNING nova.compute.manager [req-0ebf956d-f973-4b1c-aa07-85f4cc012086 req-6ddc042c-f47d-4c77-86a7-fe9ce30884a5 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received unexpected event network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 for instance with vm_state active and task_state None.
Oct 17 12:36:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:39 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:45 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:36:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:36:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:36:50 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=25.156925201416016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 91c3c273-792c-4240-9e0b-05596f3b78b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:36:50 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:36:51 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [{"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:36:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:36:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:36:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:36:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:36:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:36:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:36:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:36:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:34 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:37:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:37:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-changed-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:37:38 user nova-compute[74261]: DEBUG nova.compute.manager [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Refreshing instance network info cache due to event network-changed-dae27883-272e-4901-bb2f-949665dea6e8. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:37:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] Acquiring lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:37:38 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] Acquired lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:37:38 user nova-compute[74261]: DEBUG nova.network.neutron [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Refreshing network info cache for port dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updated VIF entry in instance network info cache for port dae27883-272e-4901-bb2f-949665dea6e8. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updating instance_info_cache with network_info: [{"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-153628b2-0e35-4e3f-92db-583b7f0a1be1 req-102efb1c-3ec4-474d-89da-8b479e73b5f3 service nova] Releasing lock "refresh_cache-91c3c273-792c-4240-9e0b-05596f3b78b1" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:39 user nova-compute[74261]: INFO nova.compute.manager [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Terminating instance
Oct 17 12:37:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-7b3e29f8-8a3e-48a9-8a66-73f141b07ee6 req-c3ac50f2-4001-40ef-81e9-5c5a522da43f service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-vif-unplugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7b3e29f8-8a3e-48a9-8a66-73f141b07ee6 req-c3ac50f2-4001-40ef-81e9-5c5a522da43f service nova] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7b3e29f8-8a3e-48a9-8a66-73f141b07ee6 req-c3ac50f2-4001-40ef-81e9-5c5a522da43f service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-7b3e29f8-8a3e-48a9-8a66-73f141b07ee6 req-c3ac50f2-4001-40ef-81e9-5c5a522da43f service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-7b3e29f8-8a3e-48a9-8a66-73f141b07ee6 req-c3ac50f2-4001-40ef-81e9-5c5a522da43f service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] No waiting events found dispatching network-vif-unplugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-7b3e29f8-8a3e-48a9-8a66-73f141b07ee6 req-c3ac50f2-4001-40ef-81e9-5c5a522da43f service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-vif-unplugged-dae27883-272e-4901-bb2f-949665dea6e8 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Instance destroyed successfully.
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.objects.instance [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'resources' on Instance uuid 91c3c273-792c-4240-9e0b-05596f3b78b1 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-536481284',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-536481284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-536481284',id=49,image_ref='a566d080-739e-41cc-bd5c-667b2c034e7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvqnzo45ZE8uqdSY7T9YqXC6S14HFsocaqJTApyRDHg93Mk34CwTte+G0JIegzYP19qIhUclyMIaPFXuHmZR5j/3rs0SFfCoqI9MTShbk17TgaPso1/vLckqPJXASluIw==',key_name='tempest-keypair-1685769046',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:36:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-ohh9gfnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2039737599',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=91c3c273-792c-4240-9e0b-05596f3b78b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "dae27883-272e-4901-bb2f-949665dea6e8", "address": "fa:16:3e:27:92:38", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae27883-27", "ovs_interfaceid": "dae27883-272e-4901-bb2f-949665dea6e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_vif [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdae27883-27, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48451c87-4aea-446a-97c0-bd03c52dcc86) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: INFO os_vif [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:92:38,bridge_name='br-int',has_traffic_filtering=True,id=dae27883-272e-4901-bb2f-949665dea6e8,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae27883-27')
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzEgIPOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:37:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[348ec0b4-140d-489b-8e6d-db533fcbf402]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:37:40 user nova-compute[74261]: No targets found.
Oct 17 12:37:40 user nova-compute[74261]: iSNS:
Oct 17 12:37:40 user nova-compute[74261]: No targets found.
Oct 17 12:37:40 user nova-compute[74261]: STATIC:
Oct 17 12:37:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724
Oct 17 12:37:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:37:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:37:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d
Oct 17 12:37:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:37:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:37:40 user nova-compute[74261]: FIRMWARE:
Oct 17 12:37:40 user nova-compute[74261]: No targets found.
Oct 17 12:37:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:37:40 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:37:40 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ae044-175d-484b-98c8-b05118a8cfc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9896d699-6dd8-4551-981f-7c1587a380fe]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:37:40 user nova-compute[74261]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 (non-flash)
Oct 17 12:37:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:37:40 user nova-compute[74261]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 (non-flash)
Oct 17 12:37:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae86b3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[18274c4b-e668-4226-9386-c3a396b087bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cf9550-47ff-452b-9eb5-4be1ef317796]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362de30-264a-4a02-9b5e-fafe8334129b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c15ba-e1c6-4ef8-8e49-dd7cb732f5dc]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO84d03a86-416cb1ca7089ee3b', '/dev/disk/by-id/scsi-23431366362316361', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_84d03a86') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7d8dfa-6fbb-4035-bb32-e21cdfa7cd45]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[242ca67a-9ab0-417b-9616-99353eb6700b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010d960-adeb-444e-a782-7ea23484b086]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260]
Oct 17 12:37:40 user nova-compute[74261]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724, portal: 172.16.0.220,3260] successful.
Oct 17 12:37:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e3081-6bd6-44b2-9468-324d26faa724 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[96821db2-4e4d-4764-af5b-89a70e7563ad]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== disconnect_volume: return (341ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:37:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Deleting instance files /opt/stack/data/nova/instances/91c3c273-792c-4240-9e0b-05596f3b78b1_del
Oct 17 12:37:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Deletion of /opt/stack/data/nova/instances/91c3c273-792c-4240-9e0b-05596f3b78b1_del complete
Oct 17 12:37:40 user nova-compute[74261]: INFO nova.compute.manager [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 17 12:37:40 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:37:40 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:37:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:41 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:37:41 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Took 0.99 seconds to deallocate network for instance.
Oct 17 12:37:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-ae630682-7da0-444f-b49d-8a7daecb26bb req-1c664f38-6765-4ff3-9072-336f8816a53d service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-vif-deleted-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-d792d42f-e291-4ffd-80ff-5d1098055b36 req-67ce5567-e740-4d9e-b744-95f072819100 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received event network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d792d42f-e291-4ffd-80ff-5d1098055b36 req-67ce5567-e740-4d9e-b744-95f072819100 service nova] Acquiring lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d792d42f-e291-4ffd-80ff-5d1098055b36 req-67ce5567-e740-4d9e-b744-95f072819100 service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d792d42f-e291-4ffd-80ff-5d1098055b36 req-67ce5567-e740-4d9e-b744-95f072819100 service nova] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG nova.compute.manager [req-d792d42f-e291-4ffd-80ff-5d1098055b36 req-67ce5567-e740-4d9e-b744-95f072819100 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] No waiting events found dispatching network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:37:42 user nova-compute[74261]: WARNING nova.compute.manager [req-d792d42f-e291-4ffd-80ff-5d1098055b36 req-67ce5567-e740-4d9e-b744-95f072819100 service nova] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Received unexpected event network-vif-plugged-dae27883-272e-4901-bb2f-949665dea6e8 for instance with vm_state active and task_state deleting.
Oct 17 12:37:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:42 user nova-compute[74261]: INFO nova.compute.manager [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Took 1.03 seconds to detach 1 volumes for instance.
Oct 17 12:37:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 91c3c273-792c-4240-9e0b-05596f3b78b1] Deleting volume: f37e3081-6bd6-44b2-9468-324d26faa724 {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:37:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:37:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:43 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Deleted allocations for instance 91c3c273-792c-4240-9e0b-05596f3b78b1
Oct 17 12:37:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-86ae8534-5337-4608-adcd-399aceabc556 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "91c3c273-792c-4240-9e0b-05596f3b78b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.947s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:45 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:45 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:37:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:37:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:37:51 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:37:52 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:37:52 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:37:52 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.156028747558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:37:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:37:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:37:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:38:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:38:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:38:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:38:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:38:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:38:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:39 user nova-compute[74261]: INFO nova.compute.manager [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Terminating instance
Oct 17 12:38:39 user nova-compute[74261]: DEBUG nova.compute.manager [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-68b33d61-7e38-4109-a17a-b110c79e0b07 req-4d0d122a-e82a-4f8d-860b-a91716577ef7 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-vif-unplugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-68b33d61-7e38-4109-a17a-b110c79e0b07 req-4d0d122a-e82a-4f8d-860b-a91716577ef7 service nova] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-68b33d61-7e38-4109-a17a-b110c79e0b07 req-4d0d122a-e82a-4f8d-860b-a91716577ef7 service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-68b33d61-7e38-4109-a17a-b110c79e0b07 req-4d0d122a-e82a-4f8d-860b-a91716577ef7 service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-68b33d61-7e38-4109-a17a-b110c79e0b07 req-4d0d122a-e82a-4f8d-860b-a91716577ef7 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] No waiting events found dispatching network-vif-unplugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:38:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-68b33d61-7e38-4109-a17a-b110c79e0b07 req-4d0d122a-e82a-4f8d-860b-a91716577ef7 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-vif-unplugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Instance destroyed successfully.
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.objects.instance [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'resources' on Instance uuid 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-34600185',display_name='tempest-TestVolumeBootPattern-volume-backed-server-34600185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-34600185',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcO2hKIZLFUT6kzLtX2vDM1JWacYRP0BYDaLz2lxUHkzxyIuBnw+FLul6wWXYsmGosLm4ZKbRLP/g6ZtEJAvtrwzH3E0cgmP87pTIKMBt4u8ADBfi+W293PVLc9XrjmSQ==',key_name='tempest-keypair-1630778731',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-vob6s9wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=8c152f52-62d4-45ae-b3f5-0c6bf1aaf215,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "address": "fa:16:3e:f4:4f:8f", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ba1c5-39", "ovs_interfaceid": "be8ba1c5-39bf-41ca-a78e-cfb1425dc056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_vif [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe8ba1c5-39, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80cc821a-73f7-4a04-ad17-90e9e9eb4950) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:40 user nova-compute[74261]: INFO os_vif [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:4f:8f,bridge_name='br-int',has_traffic_filtering=True,id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ba1c5-39')
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQNUXsyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:38:40 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda528f5-bd15-45af-83a8-eb84140da047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:38:40 user nova-compute[74261]: No targets found.
Oct 17 12:38:40 user nova-compute[74261]: iSNS:
Oct 17 12:38:40 user nova-compute[74261]: No targets found.
Oct 17 12:38:40 user nova-compute[74261]: STATIC:
Oct 17 12:38:40 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d
Oct 17 12:38:40 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:38:40 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:38:40 user nova-compute[74261]: FIRMWARE:
Oct 17 12:38:40 user nova-compute[74261]: No targets found.
Oct 17 12:38:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:38:40 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:38:40 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc09873-49ff-46e1-b5df-1f77d7bf807d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a6297-1074-4a98-9502-44865fcb1b79]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:38:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d (non-flash)
Oct 17 12:38:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae86dc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e25ae-5f0b-4381-b336-73b8589eaaaa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4311e257-f059-4c22-b3b0-7a0b4ba3c880]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8519bfc9-8938-44e5-a5ba-822c9bb3ad34]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab2fa1-d5e9-4270-90f7-02a7817e0972]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfbd4d23b-733c72d9bd9e67d5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fbd4d23b', '/dev/disk/by-id/scsi-23733336337326439') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc3c58-83d0-4997-9473-cd9313bd6aef]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c85ebdf-9fd6-4bde-a17a-4fe196d78439]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48d9ec-1b4a-470f-a2db-444c86bd38d1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260]
Oct 17 12:38:40 user nova-compute[74261]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d, portal: 172.16.0.220,3260] successful.
Oct 17 12:38:40 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f27c6b3-7994-481b-97fd-9a887a1eed0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[87267ec5-fb91-4245-bc29-fc6514d251ab]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== disconnect_volume: return (279ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:38:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Deleting instance files /opt/stack/data/nova/instances/8c152f52-62d4-45ae-b3f5-0c6bf1aaf215_del
Oct 17 12:38:40 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Deletion of /opt/stack/data/nova/instances/8c152f52-62d4-45ae-b3f5-0c6bf1aaf215_del complete
Oct 17 12:38:40 user nova-compute[74261]: INFO nova.compute.manager [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 17 12:38:40 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:38:40 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:38:41 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Took 0.63 seconds to deallocate network for instance.
Oct 17 12:38:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a2f3193-71f3-4856-b512-005deb04449b req-f9f0ca87-95c7-4165-9e6f-6089c79b683a service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-vif-deleted-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:38:41 user nova-compute[74261]: INFO nova.compute.manager [req-7a2f3193-71f3-4856-b512-005deb04449b req-f9f0ca87-95c7-4165-9e6f-6089c79b683a service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Neutron deleted interface be8ba1c5-39bf-41ca-a78e-cfb1425dc056; detaching it from the instance and deleting it from the info cache
Oct 17 12:38:41 user nova-compute[74261]: DEBUG nova.network.neutron [req-7a2f3193-71f3-4856-b512-005deb04449b req-f9f0ca87-95c7-4165-9e6f-6089c79b683a service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-7a2f3193-71f3-4856-b512-005deb04449b req-f9f0ca87-95c7-4165-9e6f-6089c79b683a service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Detach interface failed, port_id=be8ba1c5-39bf-41ca-a78e-cfb1425dc056, reason: Instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-92cb802d-76d6-4351-b74b-294992103113 req-6699e347-e936-4cdb-a452-fc37c59adfe9 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received event network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-92cb802d-76d6-4351-b74b-294992103113 req-6699e347-e936-4cdb-a452-fc37c59adfe9 service nova] Acquiring lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-92cb802d-76d6-4351-b74b-294992103113 req-6699e347-e936-4cdb-a452-fc37c59adfe9 service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-92cb802d-76d6-4351-b74b-294992103113 req-6699e347-e936-4cdb-a452-fc37c59adfe9 service nova] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-92cb802d-76d6-4351-b74b-294992103113 req-6699e347-e936-4cdb-a452-fc37c59adfe9 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] No waiting events found dispatching network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:38:41 user nova-compute[74261]: WARNING nova.compute.manager [req-92cb802d-76d6-4351-b74b-294992103113 req-6699e347-e936-4cdb-a452-fc37c59adfe9 service nova] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Received unexpected event network-vif-plugged-be8ba1c5-39bf-41ca-a78e-cfb1425dc056 for instance with vm_state active and task_state deleting.
Oct 17 12:38:42 user nova-compute[74261]: INFO nova.compute.manager [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Took 0.84 seconds to detach 1 volumes for instance.
Oct 17 12:38:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215] Deleting volume: 9f27c6b3-7994-481b-97fd-9a887a1eed0d {{(pid=74261) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 12:38:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:38:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:38:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:42 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Deleted allocations for instance 8c152f52-62d4-45ae-b3f5-0c6bf1aaf215
Oct 17 12:38:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-fda869d3-2767-47ea-8356-4f1fae903d26 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "8c152f52-62d4-45ae-b3f5-0c6bf1aaf215" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.128s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:46 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:38:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:38:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:38:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:38:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:38:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.15518569946289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:38:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:38:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:38:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:38:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:38:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:38:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:38:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:39:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:39:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:39:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:39:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:39:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:39:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:37 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:39:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:39:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:39:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:39:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "0c820859-2096-4cdb-af2e-e10b12eef520" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:39:47 user nova-compute[74261]: INFO nova.compute.claims [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Claim successful on node user
Oct 17 12:39:47 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:39:47 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:39:48 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:39:48 user nova-compute[74261]: INFO nova.virt.block_device [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Booting with volume ec0dde4d-49a4-457d-b713-1b2256512bef at /dev/vda
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.policy [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a38d9af156c42b8ad4865b983f39da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4261c4841d42488970198c3fb8fdfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG os_brick.utils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ad2b99-4135-459d-bc9a-17f85a14343b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc80517-eb91-455d-8880-9dbc301f030e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcaac7a-47ec-4eaa-8dd5-906ab765c361]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[86063b43-d38a-4dd6-93c4-f74137100211]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:39:48 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79e793-12a4-4cce-bf86-0989361a0eae]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG os_brick.utils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updating existing volume attachment record: c781de78-86c6-47df-bf3d-f7229afd5ec9 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:39:48 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Successfully created port: 61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Successfully updated port: 61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquired lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-changed-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.compute.manager [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Refreshing instance network info cache due to event network-changed-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] Acquiring lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.network.neutron [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updating instance_info_cache with network_info: [{"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Releasing lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Instance network_info: |[{"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] Acquired lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:39:49 user nova-compute[74261]: DEBUG nova.network.neutron [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Refreshing network info cache for port 61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:39:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updated VIF entry in instance network info cache for port 61ddee77-9085-40a1-bb9d-7ec2ecb5af3e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:39:50 user nova-compute[74261]: DEBUG nova.network.neutron [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updating instance_info_cache with network_info: [{"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:39:50 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-69d1bf13-de07-4c9a-a176-cf94dbecc158 req-6756cb6c-424f-4c8c-aa35-515aa98a219d service nova] Releasing lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:39:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:39:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:39:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:39:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9152MB free_disk=25.14594268798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0c820859-2096-4cdb-af2e-e10b12eef520 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:39:53 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:39:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:39:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:39:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:40:04 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Creating image(s)
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Ensure instance console log exists: /opt/stack/data/nova/instances/0c820859-2096-4cdb-af2e-e10b12eef520/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Start _get_guest_xml network_info=[{"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'c781de78-86c6-47df-bf3d-f7229afd5ec9', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c820859-2096-4cdb-af2e-e10b12eef520', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec0dde4d-49a4-457d-b713-1b2256512bef', 'serial': 'ec0dde4d-49a4-457d-b713-1b2256512bef'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:40:04 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:40:04 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:40:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:40:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:40:04 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[96389c65-beb7-45ca-8db1-e8fd88a421f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:40:04 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b62fbf-d036-4cf1-a753-ffd1b49b3b26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef] added
Oct 17 12:40:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[334570fd-3001-44a1-ab01-2443bd6b9254]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca969e7d-491d-4ed2-a6a7-9db033656c13]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEPtKuLI {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEPtKuLI" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcebc31-9492-4535-8e29-a900f4272792]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oEPtKuLI'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[72840641-9e27-4ceb-9c25-5cab191566af]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd60d8d-38ac-44a3-b91c-9ed6abc5f303]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:40:04 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:40:04 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:40:04 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:40:04 user nova-compute[74261]: 
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[39545fe0-f061-475e-866f-821cc55edf29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]
Oct 17 12:40:04 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.
Oct 17 12:40:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65e23c8-67f7-49b1-8894-e0bbacdfe76f]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d6c56b-f7ed-42de-a350-25348cf51c57]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:40:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:40:04 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f40a8e-593b-4f78-8444-c57410284e2d]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:40:04 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23630616166353834', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630616166353834', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778090493',display_name='tempest-TestVolumeBootPattern-server-778090493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-778090493',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-il77grzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:39:48Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=0c820859-2096-4cdb-af2e-e10b12eef520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.objects.instance [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c820859-2096-4cdb-af2e-e10b12eef520 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:40:05 user nova-compute[74261]:   <uuid>0c820859-2096-4cdb-af2e-e10b12eef520</uuid>
Oct 17 12:40:05 user nova-compute[74261]:   <name>instance-00000032</name>
Oct 17 12:40:05 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:40:05 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:40:05 user nova-compute[74261]:   <metadata>
Oct 17 12:40:05 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:40:05 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:40:05 user nova-compute[74261]:       <nova:name>tempest-TestVolumeBootPattern-server-778090493</nova:name>
Oct 17 12:40:05 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:40:04</nova:creationTime>
Oct 17 12:40:05 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:40:05 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:40:05 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:40:05 user nova-compute[74261]:       <nova:owner>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:user uuid="4a38d9af156c42b8ad4865b983f39da2">tempest-TestVolumeBootPattern-2039737599-project-member</nova:user>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:project uuid="9e4261c4841d42488970198c3fb8fdfd">tempest-TestVolumeBootPattern-2039737599</nova:project>
Oct 17 12:40:05 user nova-compute[74261]:       </nova:owner>
Oct 17 12:40:05 user nova-compute[74261]:       <nova:ports>
Oct 17 12:40:05 user nova-compute[74261]:         <nova:port uuid="61ddee77-9085-40a1-bb9d-7ec2ecb5af3e">
Oct 17 12:40:05 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 12:40:05 user nova-compute[74261]:         </nova:port>
Oct 17 12:40:05 user nova-compute[74261]:       </nova:ports>
Oct 17 12:40:05 user nova-compute[74261]:     </nova:instance>
Oct 17 12:40:05 user nova-compute[74261]:   </metadata>
Oct 17 12:40:05 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:40:05 user nova-compute[74261]:     <system>
Oct 17 12:40:05 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:40:05 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:40:05 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:40:05 user nova-compute[74261]:       <entry name="serial">0c820859-2096-4cdb-af2e-e10b12eef520</entry>
Oct 17 12:40:05 user nova-compute[74261]:       <entry name="uuid">0c820859-2096-4cdb-af2e-e10b12eef520</entry>
Oct 17 12:40:05 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:40:05 user nova-compute[74261]:     </system>
Oct 17 12:40:05 user nova-compute[74261]:   </sysinfo>
Oct 17 12:40:05 user nova-compute[74261]:   <os>
Oct 17 12:40:05 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:40:05 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:40:05 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:40:05 user nova-compute[74261]:   </os>
Oct 17 12:40:05 user nova-compute[74261]:   <features>
Oct 17 12:40:05 user nova-compute[74261]:     <acpi/>
Oct 17 12:40:05 user nova-compute[74261]:     <apic/>
Oct 17 12:40:05 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:40:05 user nova-compute[74261]:   </features>
Oct 17 12:40:05 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:40:05 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:40:05 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:40:05 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:40:05 user nova-compute[74261]:   </clock>
Oct 17 12:40:05 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:40:05 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:40:05 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:40:05 user nova-compute[74261]:   </cpu>
Oct 17 12:40:05 user nova-compute[74261]:   <devices>
Oct 17 12:40:05 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:40:05 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:40:05 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 12:40:05 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:40:05 user nova-compute[74261]:       <serial>ec0dde4d-49a4-457d-b713-1b2256512bef</serial>
Oct 17 12:40:05 user nova-compute[74261]:     </disk>
Oct 17 12:40:05 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:40:05 user nova-compute[74261]:       <mac address="fa:16:3e:e6:df:b0"/>
Oct 17 12:40:05 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:40:05 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:40:05 user nova-compute[74261]:       <target dev="tap61ddee77-90"/>
Oct 17 12:40:05 user nova-compute[74261]:     </interface>
Oct 17 12:40:05 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:40:05 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/0c820859-2096-4cdb-af2e-e10b12eef520/console.log" append="off"/>
Oct 17 12:40:05 user nova-compute[74261]:     </serial>
Oct 17 12:40:05 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:40:05 user nova-compute[74261]:     <video>
Oct 17 12:40:05 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:40:05 user nova-compute[74261]:     </video>
Oct 17 12:40:05 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:40:05 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:40:05 user nova-compute[74261]:     </rng>
Oct 17 12:40:05 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:40:05 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:40:05 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:40:05 user nova-compute[74261]:     </memballoon>
Oct 17 12:40:05 user nova-compute[74261]:   </devices>
Oct 17 12:40:05 user nova-compute[74261]: </domain>
Oct 17 12:40:05 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778090493',display_name='tempest-TestVolumeBootPattern-server-778090493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-778090493',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-il77grzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:39:48Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=0c820859-2096-4cdb-af2e-e10b12eef520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG os_vif [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54440ea7-8334-5fe8-b36a-c40d49e1a849', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61ddee77-90, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61ddee77-90, col_values=(('qos', UUID('531aed94-f270-442b-af19-4e63a109c232')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61ddee77-90, col_values=(('external_ids', {'iface-id': '61ddee77-9085-40a1-bb9d-7ec2ecb5af3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:df:b0', 'vm-uuid': '0c820859-2096-4cdb-af2e-e10b12eef520'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:05 user nova-compute[74261]: INFO os_vif [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90')
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:40:05 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No VIF found with MAC fa:16:3e:e6:df:b0, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-ee389639-154b-4a2e-b356-27d0a14714c8 req-e60249f4-9d12-4f9a-9ceb-0ea4708108ad service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ee389639-154b-4a2e-b356-27d0a14714c8 req-e60249f4-9d12-4f9a-9ceb-0ea4708108ad service nova] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ee389639-154b-4a2e-b356-27d0a14714c8 req-e60249f4-9d12-4f9a-9ceb-0ea4708108ad service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ee389639-154b-4a2e-b356-27d0a14714c8 req-e60249f4-9d12-4f9a-9ceb-0ea4708108ad service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:40:06 user nova-compute[74261]: DEBUG nova.compute.manager [req-ee389639-154b-4a2e-b356-27d0a14714c8 req-e60249f4-9d12-4f9a-9ceb-0ea4708108ad service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] No waiting events found dispatching network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:40:06 user nova-compute[74261]: WARNING nova.compute.manager [req-ee389639-154b-4a2e-b356-27d0a14714c8 req-e60249f4-9d12-4f9a-9ceb-0ea4708108ad service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received unexpected event network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e for instance with vm_state building and task_state spawning.
Oct 17 12:40:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:40:08 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Instance spawned successfully.
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-14518168-b1a9-4971-9ebd-b128d3b31f48 req-ffbb7408-c011-4c23-9b81-25c0be2ac20e service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-14518168-b1a9-4971-9ebd-b128d3b31f48 req-ffbb7408-c011-4c23-9b81-25c0be2ac20e service nova] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-14518168-b1a9-4971-9ebd-b128d3b31f48 req-ffbb7408-c011-4c23-9b81-25c0be2ac20e service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-14518168-b1a9-4971-9ebd-b128d3b31f48 req-ffbb7408-c011-4c23-9b81-25c0be2ac20e service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:40:08 user nova-compute[74261]: DEBUG nova.compute.manager [req-14518168-b1a9-4971-9ebd-b128d3b31f48 req-ffbb7408-c011-4c23-9b81-25c0be2ac20e service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] No waiting events found dispatching network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:40:08 user nova-compute[74261]: WARNING nova.compute.manager [req-14518168-b1a9-4971-9ebd-b128d3b31f48 req-ffbb7408-c011-4c23-9b81-25c0be2ac20e service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received unexpected event network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e for instance with vm_state building and task_state spawning.
Oct 17 12:40:09 user nova-compute[74261]: INFO nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Took 4.98 seconds to spawn the instance on the hypervisor.
Oct 17 12:40:09 user nova-compute[74261]: DEBUG nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:40:09 user nova-compute[74261]: INFO nova.compute.manager [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Took 21.31 seconds to build instance.
Oct 17 12:40:09 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-c48a09b8-d1d3-4c8a-a46f-358684ceaa8a tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "0c820859-2096-4cdb-af2e-e10b12eef520" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.410s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:40:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:40:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:41 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:40:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:40:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:40:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:40:53 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.144561767578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 0c820859-2096-4cdb-af2e-e10b12eef520 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:40:53 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:40:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:40:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:40:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 0c820859-2096-4cdb-af2e-e10b12eef520 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updating instance_info_cache with network_info: [{"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:40:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:41:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:41:08 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:41:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:24 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:24 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:41:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-changed-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:41:39 user nova-compute[74261]: DEBUG nova.compute.manager [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Refreshing instance network info cache due to event network-changed-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:41:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] Acquiring lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:41:39 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] Acquired lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:41:39 user nova-compute[74261]: DEBUG nova.network.neutron [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Refreshing network info cache for port 61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:41:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updated VIF entry in instance network info cache for port 61ddee77-9085-40a1-bb9d-7ec2ecb5af3e. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:41:40 user nova-compute[74261]: DEBUG nova.network.neutron [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updating instance_info_cache with network_info: [{"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:41:40 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-35aa3d6c-67bc-4eeb-aaf0-4608199a2b53 req-81222476-c4b9-4fdb-88a1-d0fec2e834a9 service nova] Releasing lock "refresh_cache-0c820859-2096-4cdb-af2e-e10b12eef520" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:41:40 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "0c820859-2096-4cdb-af2e-e10b12eef520" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:41 user nova-compute[74261]: INFO nova.compute.manager [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Terminating instance
Oct 17 12:41:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-ff1cea92-d3c8-4ae8-80cf-0aaa7496a115 req-3d4419e8-5141-453b-af34-902581a68cf2 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-vif-unplugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ff1cea92-d3c8-4ae8-80cf-0aaa7496a115 req-3d4419e8-5141-453b-af34-902581a68cf2 service nova] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ff1cea92-d3c8-4ae8-80cf-0aaa7496a115 req-3d4419e8-5141-453b-af34-902581a68cf2 service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ff1cea92-d3c8-4ae8-80cf-0aaa7496a115 req-3d4419e8-5141-453b-af34-902581a68cf2 service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-ff1cea92-d3c8-4ae8-80cf-0aaa7496a115 req-3d4419e8-5141-453b-af34-902581a68cf2 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] No waiting events found dispatching network-vif-unplugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:41:41 user nova-compute[74261]: DEBUG nova.compute.manager [req-ff1cea92-d3c8-4ae8-80cf-0aaa7496a115 req-3d4419e8-5141-453b-af34-902581a68cf2 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-vif-unplugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:41:41 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Instance destroyed successfully.
Oct 17 12:41:41 user nova-compute[74261]: DEBUG nova.objects.instance [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'resources' on Instance uuid 0c820859-2096-4cdb-af2e-e10b12eef520 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778090493',display_name='tempest-TestVolumeBootPattern-server-778090493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-778090493',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-il77grzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:40:09Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=0c820859-2096-4cdb-af2e-e10b12eef520,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "address": "fa:16:3e:e6:df:b0", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ddee77-90", "ovs_interfaceid": "61ddee77-9085-40a1-bb9d-7ec2ecb5af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_vif [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61ddee77-90, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=531aed94-f270-442b-af19-4e63a109c232) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:42 user nova-compute[74261]: INFO os_vif [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:df:b0,bridge_name='br-int',has_traffic_filtering=True,id=61ddee77-9085-40a1-bb9d-7ec2ecb5af3e,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ddee77-90')
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:41:42 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5883b7a-e1cd-40f1-b4b8-2e0eb73b9134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:41:42 user nova-compute[74261]: No targets found.
Oct 17 12:41:42 user nova-compute[74261]: iSNS:
Oct 17 12:41:42 user nova-compute[74261]: No targets found.
Oct 17 12:41:42 user nova-compute[74261]: STATIC:
Oct 17 12:41:42 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef
Oct 17 12:41:42 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:41:42 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:41:42 user nova-compute[74261]: FIRMWARE:
Oct 17 12:41:42 user nova-compute[74261]: No targets found.
Oct 17 12:41:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:41:42 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:41:42 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b6324f-7a86-41f0-a12a-423b8275869b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72fd630-3f30-426a-9f04-4cbe24653939]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:41:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:41:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae86b0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[421490fd-62fa-4db0-92c5-78337e08b103]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54174c-d46e-4a84-a0e4-3b34d7070d9f]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7942e5a1-6dfb-4849-b200-f9dd2cdc5d40]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0d52a6-3f61-42b8-b481-abb7895ed7c5]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO106b8ff6-60aaf584c62c3719', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_106b8ff6', '/dev/disk/by-id/scsi-23630616166353834') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0c183f-b341-4e91-88ad-c61c75d0edfb]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[71966e35-12b9-4e30-8636-9a052e46a4f7]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[631c6915-ed97-4eb9-98a0-e2f8ec56d2ca]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]
Oct 17 12:41:42 user nova-compute[74261]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.
Oct 17 12:41:42 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c44230-5d5b-4bae-ae41-602427942bb0]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== disconnect_volume: return (288ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:41:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Deleting instance files /opt/stack/data/nova/instances/0c820859-2096-4cdb-af2e-e10b12eef520_del
Oct 17 12:41:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Deletion of /opt/stack/data/nova/instances/0c820859-2096-4cdb-af2e-e10b12eef520_del complete
Oct 17 12:41:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:42 user nova-compute[74261]: INFO nova.compute.manager [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 17 12:41:42 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:41:42 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:41:43 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:41:43 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Took 0.91 seconds to deallocate network for instance.
Oct 17 12:41:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:41:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] Acquiring lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] Lock "0c820859-2096-4cdb-af2e-e10b12eef520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] No waiting events found dispatching network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:41:43 user nova-compute[74261]: WARNING nova.compute.manager [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received unexpected event network-vif-plugged-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e for instance with vm_state active and task_state deleting.
Oct 17 12:41:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-4e4dbb5c-43a1-40ac-8bbc-fc93ebad530b req-4ec45cc5-0cf0-4ea8-85a2-9fce8064e241 service nova] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Received event network-vif-deleted-61ddee77-9085-40a1-bb9d-7ec2ecb5af3e {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:41:44 user nova-compute[74261]: INFO nova.compute.manager [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 0c820859-2096-4cdb-af2e-e10b12eef520] Took 0.89 seconds to detach 1 volumes for instance.
Oct 17 12:41:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:44 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:41:44 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:41:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:44 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Deleted allocations for instance 0c820859-2096-4cdb-af2e-e10b12eef520
Oct 17 12:41:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-56c1a1b5-a90d-49f4-bfac-d14e09f33fbb tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "0c820859-2096-4cdb-af2e-e10b12eef520" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.241s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:50 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:41:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:41:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:41:54 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=25.143722534179688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:41:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:41:55 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:41:55 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:41:55 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:41:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:41:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:41:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:41:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:41:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:41:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:41:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:41:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:41:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:41:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:42:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:42:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:42:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:42:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:42:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:42:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:42:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:42:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:42:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:42:33 user nova-compute[74261]: INFO nova.compute.claims [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Claim successful on node user
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.network.neutron [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:42:33 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:42:33 user nova-compute[74261]: INFO nova.virt.block_device [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Booting with volume ec0dde4d-49a4-457d-b713-1b2256512bef at /dev/vda
Oct 17 12:42:33 user nova-compute[74261]: DEBUG os_brick.utils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.policy [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a38d9af156c42b8ad4865b983f39da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4261c4841d42488970198c3fb8fdfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58ad147-2446-4acb-a6fb-a11071e4946a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ce4ff-71d5-4565-a3da-5c0006208b98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[91657553-14f3-420c-a1fd-73a2aceedabf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[45224a16-ffb5-41f3-80a1-d548165dbc35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:42:33 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:42:33 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c6f945-c5f1-4576-9d24-ed31e20ad71d]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG os_brick.utils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:42:33 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating existing volume attachment record: d7be4e42-683d-43a3-9067-03d227804a25 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:42:34 user nova-compute[74261]: DEBUG nova.network.neutron [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Successfully created port: b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Successfully updated port: b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-changed-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.compute.manager [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Refreshing instance network info cache due to event network-changed-b97dbdd1-b7fd-429e-852e-9bf210262e83. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.network.neutron [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Instance network_info: |[{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:42:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Refreshing network info cache for port b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:42:36 user nova-compute[74261]: DEBUG nova.network.neutron [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated VIF entry in instance network info cache for port b97dbdd1-b7fd-429e-852e-9bf210262e83. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:42:36 user nova-compute[74261]: DEBUG nova.network.neutron [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:42:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ffcd84dc-15dc-448c-a7c0-dcba9a97dd7f req-7889cbd8-7c24-40ed-b79c-dc21101beec0 service nova] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:42:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:42 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:44 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:47 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:42:49 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Creating image(s)
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Ensure instance console log exists: /opt/stack/data/nova/instances/7aa2a81e-df98-4d3e-9ac4-49f77df43644/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Start _get_guest_xml network_info=[{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'd7be4e42-683d-43a3-9067-03d227804a25', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7aa2a81e-df98-4d3e-9ac4-49f77df43644', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec0dde4d-49a4-457d-b713-1b2256512bef', 'serial': 'ec0dde4d-49a4-457d-b713-1b2256512bef'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:42:49 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:42:49 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:42:49 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:42:49 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:42:49 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac8d0cf-61c5-440d-b5e8-d1583fc41c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:42:49 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[368a6637-a7aa-4652-9d76-e47f70f8860f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef] added
Oct 17 12:42:49 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b574786-e16f-48e4-8d55-f5d403bc414c]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3043cc-c0fd-4b2b-8282-43590c916573]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEPtKuLI {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEPtKuLI" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c11e79c-46e0-40cc-9209-e3d04a212cc3]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oEPtKuLI'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[badc2ab6-8682-4a5d-93d6-9d716b52fd1b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c08078-ff20-4915-aa3c-b257817b46aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:42:49 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 12:42:49 user nova-compute[74261]:  {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:42:49 user nova-compute[74261]: WARNING os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 12:42:49 user nova-compute[74261]: 
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0819025-22c6-4666-9205-894e6e9d1563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]
Oct 17 12:42:49 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.
Oct 17 12:42:49 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2babaa34-3f17-466e-888a-ecd31e5bcecb]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574562f-9d67-48bf-a6fa-3ec5c4204a70]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:42:49 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:42:49 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8287b997-f66a-4dab-ba8c-58df5dde1ad4]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:42:49 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23630616166353834', 'path': '/dev/sdb'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630616166353834', 'path': '/dev/sdb'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-382897260',display_name='tempest-TestVolumeBootPattern-server-382897260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-382897260',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-mliu00dm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:42:34Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=7aa2a81e-df98-4d3e-9ac4-49f77df43644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.objects.instance [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aa2a81e-df98-4d3e-9ac4-49f77df43644 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:42:50 user nova-compute[74261]:   <uuid>7aa2a81e-df98-4d3e-9ac4-49f77df43644</uuid>
Oct 17 12:42:50 user nova-compute[74261]:   <name>instance-00000033</name>
Oct 17 12:42:50 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:42:50 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:42:50 user nova-compute[74261]:   <metadata>
Oct 17 12:42:50 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:42:50 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:42:50 user nova-compute[74261]:       <nova:name>tempest-TestVolumeBootPattern-server-382897260</nova:name>
Oct 17 12:42:50 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:42:49</nova:creationTime>
Oct 17 12:42:50 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:42:50 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:42:50 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:42:50 user nova-compute[74261]:       <nova:owner>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:user uuid="4a38d9af156c42b8ad4865b983f39da2">tempest-TestVolumeBootPattern-2039737599-project-member</nova:user>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:project uuid="9e4261c4841d42488970198c3fb8fdfd">tempest-TestVolumeBootPattern-2039737599</nova:project>
Oct 17 12:42:50 user nova-compute[74261]:       </nova:owner>
Oct 17 12:42:50 user nova-compute[74261]:       <nova:ports>
Oct 17 12:42:50 user nova-compute[74261]:         <nova:port uuid="b97dbdd1-b7fd-429e-852e-9bf210262e83">
Oct 17 12:42:50 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 12:42:50 user nova-compute[74261]:         </nova:port>
Oct 17 12:42:50 user nova-compute[74261]:       </nova:ports>
Oct 17 12:42:50 user nova-compute[74261]:     </nova:instance>
Oct 17 12:42:50 user nova-compute[74261]:   </metadata>
Oct 17 12:42:50 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:42:50 user nova-compute[74261]:     <system>
Oct 17 12:42:50 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:42:50 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:42:50 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:42:50 user nova-compute[74261]:       <entry name="serial">7aa2a81e-df98-4d3e-9ac4-49f77df43644</entry>
Oct 17 12:42:50 user nova-compute[74261]:       <entry name="uuid">7aa2a81e-df98-4d3e-9ac4-49f77df43644</entry>
Oct 17 12:42:50 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:42:50 user nova-compute[74261]:     </system>
Oct 17 12:42:50 user nova-compute[74261]:   </sysinfo>
Oct 17 12:42:50 user nova-compute[74261]:   <os>
Oct 17 12:42:50 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:42:50 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:42:50 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:42:50 user nova-compute[74261]:   </os>
Oct 17 12:42:50 user nova-compute[74261]:   <features>
Oct 17 12:42:50 user nova-compute[74261]:     <acpi/>
Oct 17 12:42:50 user nova-compute[74261]:     <apic/>
Oct 17 12:42:50 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:42:50 user nova-compute[74261]:   </features>
Oct 17 12:42:50 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:42:50 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:42:50 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:42:50 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:42:50 user nova-compute[74261]:   </clock>
Oct 17 12:42:50 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:42:50 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:42:50 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:42:50 user nova-compute[74261]:   </cpu>
Oct 17 12:42:50 user nova-compute[74261]:   <devices>
Oct 17 12:42:50 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:42:50 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:42:50 user nova-compute[74261]:       <source dev="/dev/sdb"/>
Oct 17 12:42:50 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:42:50 user nova-compute[74261]:       <serial>ec0dde4d-49a4-457d-b713-1b2256512bef</serial>
Oct 17 12:42:50 user nova-compute[74261]:     </disk>
Oct 17 12:42:50 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:42:50 user nova-compute[74261]:       <mac address="fa:16:3e:71:5f:03"/>
Oct 17 12:42:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:42:50 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:42:50 user nova-compute[74261]:       <target dev="tapb97dbdd1-b7"/>
Oct 17 12:42:50 user nova-compute[74261]:     </interface>
Oct 17 12:42:50 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:42:50 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/7aa2a81e-df98-4d3e-9ac4-49f77df43644/console.log" append="off"/>
Oct 17 12:42:50 user nova-compute[74261]:     </serial>
Oct 17 12:42:50 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:42:50 user nova-compute[74261]:     <video>
Oct 17 12:42:50 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:42:50 user nova-compute[74261]:     </video>
Oct 17 12:42:50 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:42:50 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:42:50 user nova-compute[74261]:     </rng>
Oct 17 12:42:50 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:42:50 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:42:50 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:42:50 user nova-compute[74261]:     </memballoon>
Oct 17 12:42:50 user nova-compute[74261]:   </devices>
Oct 17 12:42:50 user nova-compute[74261]: </domain>
Oct 17 12:42:50 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-382897260',display_name='tempest-TestVolumeBootPattern-server-382897260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-382897260',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-mliu00dm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:42:34Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=7aa2a81e-df98-4d3e-9ac4-49f77df43644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG os_vif [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '921dacc2-e8b0-5cc6-8f7b-906249d1fbaf', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb97dbdd1-b7, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb97dbdd1-b7, col_values=(('qos', UUID('1d1cd5c0-98b6-44ca-9713-5e4c3e722cb0')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb97dbdd1-b7, col_values=(('external_ids', {'iface-id': 'b97dbdd1-b7fd-429e-852e-9bf210262e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:5f:03', 'vm-uuid': '7aa2a81e-df98-4d3e-9ac4-49f77df43644'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:50 user nova-compute[74261]: INFO os_vif [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7')
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:42:50 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No VIF found with MAC fa:16:3e:71:5f:03, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:42:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-fe955c90-5cb6-4b59-ac53-e56b37ccb3aa req-870eb262-b5e3-4c3e-9881-e8eb850a4509 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fe955c90-5cb6-4b59-ac53-e56b37ccb3aa req-870eb262-b5e3-4c3e-9881-e8eb850a4509 service nova] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fe955c90-5cb6-4b59-ac53-e56b37ccb3aa req-870eb262-b5e3-4c3e-9881-e8eb850a4509 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fe955c90-5cb6-4b59-ac53-e56b37ccb3aa req-870eb262-b5e3-4c3e-9881-e8eb850a4509 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-fe955c90-5cb6-4b59-ac53-e56b37ccb3aa req-870eb262-b5e3-4c3e-9881-e8eb850a4509 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] No waiting events found dispatching network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:42:52 user nova-compute[74261]: WARNING nova.compute.manager [req-fe955c90-5cb6-4b59-ac53-e56b37ccb3aa req-870eb262-b5e3-4c3e-9881-e8eb850a4509 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received unexpected event network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 for instance with vm_state building and task_state spawning.
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:42:54 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Instance spawned successfully.
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f410e8a-b9f3-46b8-b5dc-7e7d068286ff req-883ed774-8932-461e-a97f-d105b7b5a8c8 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f410e8a-b9f3-46b8-b5dc-7e7d068286ff req-883ed774-8932-461e-a97f-d105b7b5a8c8 service nova] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f410e8a-b9f3-46b8-b5dc-7e7d068286ff req-883ed774-8932-461e-a97f-d105b7b5a8c8 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8f410e8a-b9f3-46b8-b5dc-7e7d068286ff req-883ed774-8932-461e-a97f-d105b7b5a8c8 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-8f410e8a-b9f3-46b8-b5dc-7e7d068286ff req-883ed774-8932-461e-a97f-d105b7b5a8c8 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] No waiting events found dispatching network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:42:54 user nova-compute[74261]: WARNING nova.compute.manager [req-8f410e8a-b9f3-46b8-b5dc-7e7d068286ff req-883ed774-8932-461e-a97f-d105b7b5a8c8 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received unexpected event network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 for instance with vm_state building and task_state spawning.
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:42:54 user nova-compute[74261]: INFO nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 17 12:42:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:42:54 user nova-compute[74261]: INFO nova.compute.manager [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Took 21.35 seconds to build instance.
Oct 17 12:42:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-5dc9279e-36a4-4e52-9e0f-bfa65a42cd98 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.455s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 7aa2a81e-df98-4d3e-9ac4-49f77df43644 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:42:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:42:56 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:42:56 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:42:56 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.14206314086914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:42:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7aa2a81e-df98-4d3e-9ac4-49f77df43644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:42:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:05 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:43:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:43 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:43:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:43:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:43:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:43:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:43:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 7aa2a81e-df98-4d3e-9ac4-49f77df43644 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:43:56 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:43:57 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:43:57 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:43:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.141380310058594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7aa2a81e-df98-4d3e-9ac4-49f77df43644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:43:57 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:43:58 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:43:58 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:43:58 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:43:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:44:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:44:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-changed-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG nova.compute.manager [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Refreshing instance network info cache due to event network-changed-b97dbdd1-b7fd-429e-852e-9bf210262e83. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG nova.network.neutron [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Refreshing network info cache for port b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG nova.network.neutron [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated VIF entry in instance network info cache for port b97dbdd1-b7fd-429e-852e-9bf210262e83. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG nova.network.neutron [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-2b7f2a6c-dc30-4899-aa47-9ae40229e59a req-0f1a2541-2d35-4466-b424-292bee370b66 service nova] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:44:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:44:41 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "d5405db7-1cf3-4675-a643-85bc61defef4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:44:41 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Starting instance... {{(pid=74261) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74261) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 12:44:42 user nova-compute[74261]: INFO nova.compute.claims [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Claim successful on node user
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Start building networks asynchronously for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Allocating IP information in the background. {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] allocate_for_instance() {{(pid=74261) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 12:44:42 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Start building block device mappings for instance. {{(pid=74261) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.policy [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a38d9af156c42b8ad4865b983f39da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4261c4841d42488970198c3fb8fdfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74261) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 12:44:42 user nova-compute[74261]: INFO nova.virt.block_device [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Booting with volume 4c8d55ac-b91b-464e-8499-057fb3e75c1a at /dev/vda
Oct 17 12:44:42 user nova-compute[74261]: DEBUG os_brick.utils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660db5e-660d-466d-9c5c-38e59fa06cc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a921d848393\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6127f25-f674-4b37-b8bd-38bdf5238175]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9bf52-0d13-40da-be45-3b101575353c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab0aa9-8cc9-411e-b36f-b5a043127c47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Running cmd (subprocess): nvme version {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74261) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] nvme not present on system {{(pid=74261) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 12:44:42 user nova-compute[74261]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 12:44:42 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8eab0e-7f77-49be-9ae1-2ad15e2d2aed]: (4, '') {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74261) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] LIGHTOS: no hostnqn found. {{(pid=74261) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG os_brick.utils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a921d848393', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:44:42 user nova-compute[74261]: DEBUG nova.virt.block_device [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating existing volume attachment record: 023f49ec-a43c-4ebb-b4a0-e96f7b3afb72 {{(pid=74261) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Successfully created port: a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Successfully updated port: a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquired lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Building network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-changed-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG nova.compute.manager [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Refreshing instance network info cache due to event network-changed-a6e49fb8-5642-4706-aea5-4ce740854960. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] Acquiring lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:44:43 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Instance cache missing network info. {{(pid=74261) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating instance_info_cache with network_info: [{"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Releasing lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Instance network_info: |[{"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74261) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] Acquired lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Refreshing network info cache for port a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updated VIF entry in instance network info cache for port a6e49fb8-5642-4706-aea5-4ce740854960. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG nova.network.neutron [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating instance_info_cache with network_info: [{"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:44:44 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-fb26ea0d-d258-4c8f-9fd3-6042465896c4 req-58640508-4864-462e-8daf-092c8ed8e6e7 service nova] Releasing lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:44:45 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:47 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:44:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Start spawning the instance on the hypervisor. {{(pid=74261) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Creating instance directory {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 12:44:58 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Creating image(s)
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Did not create local disks {{(pid=74261) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Ensure instance console log exists: /opt/stack/data/nova/instances/d5405db7-1cf3-4675-a643-85bc61defef4/console.log {{(pid=74261) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Start _get_guest_xml network_info=[{"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '023f49ec-a43c-4ebb-b4a0-e96f7b3afb72', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDeFUZRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5405db7-1cf3-4675-a643-85bc61defef4', 'attached_at': '', 'detached_at': '', 'volume_id': '4c8d55ac-b91b-464e-8499-057fb3e75c1a', 'serial': '4c8d55ac-b91b-464e-8499-057fb3e75c1a'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 12:44:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:44:58 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller missing on host. {{(pid=74261) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.host [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU controller found on host. {{(pid=74261) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74261) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T11:40:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image limits 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flavor pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Image pref 0:0:0 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Got 1 possible topologies {{(pid=74261) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.hardware [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74261) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Calling os-brick to attach iSCSI Volume {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDeFUZRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:44:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:44:58 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:44:58 user nova-compute[74261]: INFO os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cd5a78-bd9d-4137-bddc-7c62d16853a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 12:44:58 user nova-compute[74261]:  {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e130b0ca-bc59-4c38-90f7-66ca48dd83a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a] added\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a] added
Oct 17 12:44:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Skipping network cache update for instance because it is Building. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a1c63-f676-426b-900e-4de4ca2c7b4b]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0363cba-074d-44fd-811a-f3d3e6b2bb2a]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDeFUZRw {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 7aa2a81e-df98-4d3e-9ac4-49f77df43644 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDeFUZRw" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e03ffd-a962-4523-be51-4107097c3af5]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDeFUZRw'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01c0aa-f8c8-4bc0-9d83-293b39ca24c8]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b3e2b2-62bb-422d-8281-7aa807ad8ead]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:44:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:44:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --login {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fcab13-eab8-4619-aaf0-262abce538ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260]
Oct 17 12:44:58 user nova-compute[74261]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260] successful.
Oct 17 12:44:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ea6b3b-d610-4f1b-a13a-3425ae43849d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fb8a2a-5e3c-4ee3-a179-111f4b89471c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:44:58 user nova-compute[74261]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a (non-flash)
Oct 17 12:44:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:44:58 user nova-compute[74261]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a (non-flash)
Oct 17 12:44:58 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to 172.16.0.220:3260 {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74261) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74261) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c200780-b4f1-4122-a802-1ff96827395e]: (4, ('- - 0', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:44:58 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74261) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDeFUZRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74261) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23730303761656138', 'path': '/dev/sdc'} {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730303761656138', 'path': '/dev/sdc'} {{(pid=74261) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 12:44:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:44:59 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=25.14013671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1864279584',display_name='tempest-TestVolumeBootPattern-server-1864279584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1864279584',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-0wvge6rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:44:42Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=d5405db7-1cf3-4675-a643-85bc61defef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74261) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.objects.instance [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'pci_devices' on Instance uuid d5405db7-1cf3-4675-a643-85bc61defef4 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] End _get_guest_xml xml=<domain type="kvm">
Oct 17 12:44:59 user nova-compute[74261]:   <uuid>d5405db7-1cf3-4675-a643-85bc61defef4</uuid>
Oct 17 12:44:59 user nova-compute[74261]:   <name>instance-00000034</name>
Oct 17 12:44:59 user nova-compute[74261]:   <memory>524288</memory>
Oct 17 12:44:59 user nova-compute[74261]:   <vcpu>1</vcpu>
Oct 17 12:44:59 user nova-compute[74261]:   <metadata>
Oct 17 12:44:59 user nova-compute[74261]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 12:44:59 user nova-compute[74261]:       <nova:package version="0.0.0"/>
Oct 17 12:44:59 user nova-compute[74261]:       <nova:name>tempest-TestVolumeBootPattern-server-1864279584</nova:name>
Oct 17 12:44:59 user nova-compute[74261]:       <nova:creationTime>2023-10-17 12:44:58</nova:creationTime>
Oct 17 12:44:59 user nova-compute[74261]:       <nova:flavor name="m1.tiny">
Oct 17 12:44:59 user nova-compute[74261]:         <nova:memory>512</nova:memory>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:disk>1</nova:disk>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:swap>0</nova:swap>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:vcpus>1</nova:vcpus>
Oct 17 12:44:59 user nova-compute[74261]:       </nova:flavor>
Oct 17 12:44:59 user nova-compute[74261]:       <nova:owner>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:user uuid="4a38d9af156c42b8ad4865b983f39da2">tempest-TestVolumeBootPattern-2039737599-project-member</nova:user>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:project uuid="9e4261c4841d42488970198c3fb8fdfd">tempest-TestVolumeBootPattern-2039737599</nova:project>
Oct 17 12:44:59 user nova-compute[74261]:       </nova:owner>
Oct 17 12:44:59 user nova-compute[74261]:       <nova:ports>
Oct 17 12:44:59 user nova-compute[74261]:         <nova:port uuid="a6e49fb8-5642-4706-aea5-4ce740854960">
Oct 17 12:44:59 user nova-compute[74261]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 12:44:59 user nova-compute[74261]:         </nova:port>
Oct 17 12:44:59 user nova-compute[74261]:       </nova:ports>
Oct 17 12:44:59 user nova-compute[74261]:     </nova:instance>
Oct 17 12:44:59 user nova-compute[74261]:   </metadata>
Oct 17 12:44:59 user nova-compute[74261]:   <sysinfo type="smbios">
Oct 17 12:44:59 user nova-compute[74261]:     <system>
Oct 17 12:44:59 user nova-compute[74261]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 12:44:59 user nova-compute[74261]:       <entry name="product">OpenStack Nova</entry>
Oct 17 12:44:59 user nova-compute[74261]:       <entry name="version">0.0.0</entry>
Oct 17 12:44:59 user nova-compute[74261]:       <entry name="serial">d5405db7-1cf3-4675-a643-85bc61defef4</entry>
Oct 17 12:44:59 user nova-compute[74261]:       <entry name="uuid">d5405db7-1cf3-4675-a643-85bc61defef4</entry>
Oct 17 12:44:59 user nova-compute[74261]:       <entry name="family">Virtual Machine</entry>
Oct 17 12:44:59 user nova-compute[74261]:     </system>
Oct 17 12:44:59 user nova-compute[74261]:   </sysinfo>
Oct 17 12:44:59 user nova-compute[74261]:   <os>
Oct 17 12:44:59 user nova-compute[74261]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 12:44:59 user nova-compute[74261]:     <boot dev="hd"/>
Oct 17 12:44:59 user nova-compute[74261]:     <smbios mode="sysinfo"/>
Oct 17 12:44:59 user nova-compute[74261]:   </os>
Oct 17 12:44:59 user nova-compute[74261]:   <features>
Oct 17 12:44:59 user nova-compute[74261]:     <acpi/>
Oct 17 12:44:59 user nova-compute[74261]:     <apic/>
Oct 17 12:44:59 user nova-compute[74261]:     <vmcoreinfo/>
Oct 17 12:44:59 user nova-compute[74261]:   </features>
Oct 17 12:44:59 user nova-compute[74261]:   <clock offset="utc">
Oct 17 12:44:59 user nova-compute[74261]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 12:44:59 user nova-compute[74261]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 12:44:59 user nova-compute[74261]:     <timer name="hpet" present="no"/>
Oct 17 12:44:59 user nova-compute[74261]:   </clock>
Oct 17 12:44:59 user nova-compute[74261]:   <cpu mode="custom" match="exact">
Oct 17 12:44:59 user nova-compute[74261]:     <model>Nehalem</model>
Oct 17 12:44:59 user nova-compute[74261]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 12:44:59 user nova-compute[74261]:   </cpu>
Oct 17 12:44:59 user nova-compute[74261]:   <devices>
Oct 17 12:44:59 user nova-compute[74261]:     <disk type="block" device="disk">
Oct 17 12:44:59 user nova-compute[74261]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 12:44:59 user nova-compute[74261]:       <source dev="/dev/sdc"/>
Oct 17 12:44:59 user nova-compute[74261]:       <target dev="vda" bus="virtio"/>
Oct 17 12:44:59 user nova-compute[74261]:       <serial>4c8d55ac-b91b-464e-8499-057fb3e75c1a</serial>
Oct 17 12:44:59 user nova-compute[74261]:     </disk>
Oct 17 12:44:59 user nova-compute[74261]:     <interface type="ethernet">
Oct 17 12:44:59 user nova-compute[74261]:       <mac address="fa:16:3e:3c:2c:2b"/>
Oct 17 12:44:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:44:59 user nova-compute[74261]:       <mtu size="1442"/>
Oct 17 12:44:59 user nova-compute[74261]:       <target dev="tapa6e49fb8-56"/>
Oct 17 12:44:59 user nova-compute[74261]:     </interface>
Oct 17 12:44:59 user nova-compute[74261]:     <serial type="pty">
Oct 17 12:44:59 user nova-compute[74261]:       <log file="/opt/stack/data/nova/instances/d5405db7-1cf3-4675-a643-85bc61defef4/console.log" append="off"/>
Oct 17 12:44:59 user nova-compute[74261]:     </serial>
Oct 17 12:44:59 user nova-compute[74261]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 12:44:59 user nova-compute[74261]:     <video>
Oct 17 12:44:59 user nova-compute[74261]:       <model type="virtio"/>
Oct 17 12:44:59 user nova-compute[74261]:     </video>
Oct 17 12:44:59 user nova-compute[74261]:     <rng model="virtio">
Oct 17 12:44:59 user nova-compute[74261]:       <backend model="random">/dev/urandom</backend>
Oct 17 12:44:59 user nova-compute[74261]:     </rng>
Oct 17 12:44:59 user nova-compute[74261]:     <controller type="usb" index="0" model="none"/>
Oct 17 12:44:59 user nova-compute[74261]:     <memballoon model="virtio">
Oct 17 12:44:59 user nova-compute[74261]:       <stats period="10"/>
Oct 17 12:44:59 user nova-compute[74261]:     </memballoon>
Oct 17 12:44:59 user nova-compute[74261]:   </devices>
Oct 17 12:44:59 user nova-compute[74261]: </domain>
Oct 17 12:44:59 user nova-compute[74261]:  {{(pid=74261) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1864279584',display_name='tempest-TestVolumeBootPattern-server-1864279584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1864279584',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-0wvge6rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T12:44:42Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=d5405db7-1cf3-4675-a643-85bc61defef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG os_vif [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56') {{(pid=74261) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2393bc81-7799-5714-afa3-8a0dc53180e8', '_type': 'linux-noop'}}, row=False) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6e49fb8-56, may_exist=True, interface_attrs={}) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6e49fb8-56, col_values=(('qos', UUID('c60d90f1-e1ae-41a8-9286-6221de017f40')),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6e49fb8-56, col_values=(('external_ids', {'iface-id': 'a6e49fb8-5642-4706-aea5-4ce740854960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:2c:2b', 'vm-uuid': 'd5405db7-1cf3-4675-a643-85bc61defef4'}),), if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:44:59 user nova-compute[74261]: INFO os_vif [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56')
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7aa2a81e-df98-4d3e-9ac4-49f77df43644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d5405db7-1cf3-4675-a643-85bc61defef4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74261) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 12:44:59 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] No VIF found with MAC fa:16:3e:3c:2c:2b, not building metadata {{(pid=74261) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 12:45:00 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:45:00 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:45:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:45:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-13bb74cb-efd0-41a2-9c76-a24a06dae1bb req-222a54cf-c688-4323-91bc-40a58316ae97 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-13bb74cb-efd0-41a2-9c76-a24a06dae1bb req-222a54cf-c688-4323-91bc-40a58316ae97 service nova] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-13bb74cb-efd0-41a2-9c76-a24a06dae1bb req-222a54cf-c688-4323-91bc-40a58316ae97 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-13bb74cb-efd0-41a2-9c76-a24a06dae1bb req-222a54cf-c688-4323-91bc-40a58316ae97 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG nova.compute.manager [req-13bb74cb-efd0-41a2-9c76-a24a06dae1bb req-222a54cf-c688-4323-91bc-40a58316ae97 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] No waiting events found dispatching network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:45:01 user nova-compute[74261]: WARNING nova.compute.manager [req-13bb74cb-efd0-41a2-9c76-a24a06dae1bb req-222a54cf-c688-4323-91bc-40a58316ae97 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received unexpected event network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 for instance with vm_state building and task_state spawning.
Oct 17 12:45:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:01 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Instance event wait completed in 0 seconds for  {{(pid=74261) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Guest created on hypervisor {{(pid=74261) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 12:45:03 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Instance spawned successfully.
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Found default for hw_cdrom_bus of ide {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Found default for hw_disk_bus of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Found default for hw_input_bus of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Found default for hw_pointer_model of None {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Found default for hw_video_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Found default for hw_vif_model of virtio {{(pid=74261) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 12:45:03 user nova-compute[74261]: INFO nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Took 5.07 seconds to spawn the instance on the hypervisor.
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Checking state {{(pid=74261) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 12:45:03 user nova-compute[74261]: INFO nova.compute.manager [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Took 21.44 seconds to build instance.
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-66f2bda1-71e4-4836-8ae4-0116030878c4 req-ea486e18-9d81-42c3-bf32-a64df154a082 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66f2bda1-71e4-4836-8ae4-0116030878c4 req-ea486e18-9d81-42c3-bf32-a64df154a082 service nova] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66f2bda1-71e4-4836-8ae4-0116030878c4 req-ea486e18-9d81-42c3-bf32-a64df154a082 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-66f2bda1-71e4-4836-8ae4-0116030878c4 req-ea486e18-9d81-42c3-bf32-a64df154a082 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:45:03 user nova-compute[74261]: DEBUG nova.compute.manager [req-66f2bda1-71e4-4836-8ae4-0116030878c4 req-ea486e18-9d81-42c3-bf32-a64df154a082 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] No waiting events found dispatching network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:45:03 user nova-compute[74261]: WARNING nova.compute.manager [req-66f2bda1-71e4-4836-8ae4-0116030878c4 req-ea486e18-9d81-42c3-bf32-a64df154a082 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received unexpected event network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 for instance with vm_state active and task_state None.
Oct 17 12:45:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-a3e414ce-114b-44f7-aca3-3c758496511e tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "d5405db7-1cf3-4675-a643-85bc61defef4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.569s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:45:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:06 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:39 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:45:42 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:44 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:49 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:45:54 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:45:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:45:59 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Forcefully refreshing network info cache for instance {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.objects.instance [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lazy-loading 'info_cache' on Instance uuid 7aa2a81e-df98-4d3e-9ac4-49f77df43644 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.network.neutron [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated the network info_cache for instance {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:46:01 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:46:01 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=25.138896942138672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7aa2a81e-df98-4d3e-9ac4-49f77df43644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance d5405db7-1cf3-4675-a643-85bc61defef4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:46:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:04 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:46:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:46:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:46:09 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:14 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:16 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 12:46:16 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] There are 0 instances to clean {{(pid=74261) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 12:46:19 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:24 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:29 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-changed-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG nova.compute.manager [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Refreshing instance network info cache due to event network-changed-a6e49fb8-5642-4706-aea5-4ce740854960. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] Acquiring lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] Acquired lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG nova.network.neutron [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Refreshing network info cache for port a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG nova.network.neutron [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updated VIF entry in instance network info cache for port a6e49fb8-5642-4706-aea5-4ce740854960. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG nova.network.neutron [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating instance_info_cache with network_info: [{"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:46:33 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-6f6c7fc2-fe2a-40e4-bece-711caba7a5f6 req-e106b44e-f839-468a-b75f-31fbbeb8e74a service nova] Releasing lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "d5405db7-1cf3-4675-a643-85bc61defef4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-changed-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Refreshing instance network info cache due to event network-changed-a6e49fb8-5642-4706-aea5-4ce740854960. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] Acquiring lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] Acquired lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.network.neutron [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Refreshing network info cache for port a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:46:34 user nova-compute[74261]: INFO nova.compute.manager [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Terminating instance
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.compute.manager [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7401a1a-8b5e-40b3-b05c-66784e8e7db8 req-b33318ba-2a9e-448d-826a-3716986562b8 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-vif-unplugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7401a1a-8b5e-40b3-b05c-66784e8e7db8 req-b33318ba-2a9e-448d-826a-3716986562b8 service nova] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7401a1a-8b5e-40b3-b05c-66784e8e7db8 req-b33318ba-2a9e-448d-826a-3716986562b8 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-c7401a1a-8b5e-40b3-b05c-66784e8e7db8 req-b33318ba-2a9e-448d-826a-3716986562b8 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7401a1a-8b5e-40b3-b05c-66784e8e7db8 req-b33318ba-2a9e-448d-826a-3716986562b8 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] No waiting events found dispatching network-vif-unplugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG nova.compute.manager [req-c7401a1a-8b5e-40b3-b05c-66784e8e7db8 req-b33318ba-2a9e-448d-826a-3716986562b8 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-vif-unplugged-a6e49fb8-5642-4706-aea5-4ce740854960 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:34 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updated VIF entry in instance network info cache for port a6e49fb8-5642-4706-aea5-4ce740854960. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.network.neutron [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating instance_info_cache with network_info: [{"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-8a5bbfae-9f6b-4df4-a3a1-ecd9c0f68529 req-45148342-abb8-4e8c-9ae9-afd758052061 service nova] Releasing lock "refresh_cache-d5405db7-1cf3-4675-a643-85bc61defef4" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Instance destroyed successfully.
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.objects.instance [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'resources' on Instance uuid d5405db7-1cf3-4675-a643-85bc61defef4 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1864279584',display_name='tempest-TestVolumeBootPattern-server-1864279584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1864279584',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-0wvge6rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:45:03Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=d5405db7-1cf3-4675-a643-85bc61defef4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "a6e49fb8-5642-4706-aea5-4ce740854960", "address": "fa:16:3e:3c:2c:2b", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e49fb8-56", "ovs_interfaceid": "a6e49fb8-5642-4706-aea5-4ce740854960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_vif [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6e49fb8-56, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c60d90f1-e1ae-41a8-9286-6221de017f40) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:35 user nova-compute[74261]: INFO os_vif [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:2c:2b,bridge_name='br-int',has_traffic_filtering=True,id=a6e49fb8-5642-4706-aea5-4ce740854960,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e49fb8-56')
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDeFUZRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:46:35 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13cee2e-6b2e-4633-87e1-8ba30ae04053]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:46:35 user nova-compute[74261]: No targets found.
Oct 17 12:46:35 user nova-compute[74261]: iSNS:
Oct 17 12:46:35 user nova-compute[74261]: No targets found.
Oct 17 12:46:35 user nova-compute[74261]: STATIC:
Oct 17 12:46:35 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef
Oct 17 12:46:35 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:46:35 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:46:35 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a
Oct 17 12:46:35 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:46:35 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:46:35 user nova-compute[74261]: FIRMWARE:
Oct 17 12:46:35 user nova-compute[74261]: No targets found.
Oct 17 12:46:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:46:35 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:46:35 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52defa6c-38ff-47c6-8068-d5ee4cc3cab2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73304d-8334-4694-aeab-bdaf3af19126]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:46:35 user nova-compute[74261]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a (non-flash)
Oct 17 12:46:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:46:35 user nova-compute[74261]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a (non-flash)
Oct 17 12:46:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8ae86df250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a'): ({'sdc'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Removing single pathed devices sdc {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f1419-eb0c-4723-a277-4200c20467d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[28246fa6-2641-49d4-b060-3f3aec37ceb9]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flushing IO for device /dev/sdc {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[34124609-c911-4106-a94a-ef11cfce3496]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e770c-221b-4efd-8cbc-cd7e44d3ac96]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] SCSI volumes sdc have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6cc22332-7007aea8d3ec4355', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6cc22332', '/dev/disk/by-id/scsi-23730303761656138') {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bef0bf-7e6a-43d8-b557-191c0fcde371]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff470fa1-90b3-416c-a1ee-0a3b91822e99]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e2cdd-4f32-4ea5-b1e1-0d7c31248b27]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260]
Oct 17 12:46:35 user nova-compute[74261]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a, portal: 172.16.0.220,3260] successful.
Oct 17 12:46:35 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c8d55ac-b91b-464e-8499-057fb3e75c1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5daf43c-df59-4653-9e68-08c9846add37]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== disconnect_volume: return (289ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:46:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Deleting instance files /opt/stack/data/nova/instances/d5405db7-1cf3-4675-a643-85bc61defef4_del
Oct 17 12:46:35 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Deletion of /opt/stack/data/nova/instances/d5405db7-1cf3-4675-a643-85bc61defef4_del complete
Oct 17 12:46:35 user nova-compute[74261]: INFO nova.compute.manager [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 17 12:46:35 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:46:35 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-63a0423d-1aad-4254-95fa-6ea6c3e2d124 req-1bc0eeef-c9b1-4e01-842c-8cff62d3791b service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-vif-deleted-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:46:36 user nova-compute[74261]: INFO nova.compute.manager [req-63a0423d-1aad-4254-95fa-6ea6c3e2d124 req-1bc0eeef-c9b1-4e01-842c-8cff62d3791b service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Neutron deleted interface a6e49fb8-5642-4706-aea5-4ce740854960; detaching it from the instance and deleting it from the info cache
Oct 17 12:46:36 user nova-compute[74261]: DEBUG nova.network.neutron [req-63a0423d-1aad-4254-95fa-6ea6c3e2d124 req-1bc0eeef-c9b1-4e01-842c-8cff62d3791b service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:46:36 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Took 0.45 seconds to deallocate network for instance.
Oct 17 12:46:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-63a0423d-1aad-4254-95fa-6ea6c3e2d124 req-1bc0eeef-c9b1-4e01-842c-8cff62d3791b service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Detach interface failed, port_id=a6e49fb8-5642-4706-aea5-4ce740854960, reason: Instance d5405db7-1cf3-4675-a643-85bc61defef4 could not be found. {{(pid=74261) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-9cfe7a5e-e7ae-4b63-aa4c-9e2a23761b1a req-a0ce4f0d-55da-4f81-99a3-1b553de5e4a7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received event network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9cfe7a5e-e7ae-4b63-aa4c-9e2a23761b1a req-a0ce4f0d-55da-4f81-99a3-1b553de5e4a7 service nova] Acquiring lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9cfe7a5e-e7ae-4b63-aa4c-9e2a23761b1a req-a0ce4f0d-55da-4f81-99a3-1b553de5e4a7 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-9cfe7a5e-e7ae-4b63-aa4c-9e2a23761b1a req-a0ce4f0d-55da-4f81-99a3-1b553de5e4a7 service nova] Lock "d5405db7-1cf3-4675-a643-85bc61defef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:36 user nova-compute[74261]: DEBUG nova.compute.manager [req-9cfe7a5e-e7ae-4b63-aa4c-9e2a23761b1a req-a0ce4f0d-55da-4f81-99a3-1b553de5e4a7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] No waiting events found dispatching network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:46:36 user nova-compute[74261]: WARNING nova.compute.manager [req-9cfe7a5e-e7ae-4b63-aa4c-9e2a23761b1a req-a0ce4f0d-55da-4f81-99a3-1b553de5e4a7 service nova] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Received unexpected event network-vif-plugged-a6e49fb8-5642-4706-aea5-4ce740854960 for instance with vm_state active and task_state deleting.
Oct 17 12:46:37 user nova-compute[74261]: INFO nova.compute.manager [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: d5405db7-1cf3-4675-a643-85bc61defef4] Took 0.90 seconds to detach 1 volumes for instance.
Oct 17 12:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:46:37 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:46:37 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:37 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Deleted allocations for instance d5405db7-1cf3-4675-a643-85bc61defef4
Oct 17 12:46:37 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-d428d2f2-e0d3-4e5a-833c-a4a46bd16011 tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "d5405db7-1cf3-4675-a643-85bc61defef4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.862s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:46:37 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:38 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:38 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74261) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 12:46:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:46:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:46 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:46:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:46:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:46:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74261) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 12:47:00 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:47:00 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:47:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.138015747070312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Instance 7aa2a81e-df98-4d3e-9ac4-49f77df43644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74261) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:47:00 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing inventories for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating ProviderTree inventory for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Updating inventory in ProviderTree for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing aggregate associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, aggregates: None {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Refreshing trait associations for resource provider d51b7aad-e6a4-40b3-931d-8430348db4c8, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2 {{(pid=74261) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:47:01 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:47:03 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:47:05 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:08 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:47:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:47:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:47:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:15 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:20 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:25 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:30 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:35 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:40 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:45 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:48 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:50 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:51 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-changed-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.compute.manager [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Refreshing instance network info cache due to event network-changed-b97dbdd1-b7fd-429e-852e-9bf210262e83. {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] Acquiring lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] Acquired lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.network.neutron [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Refreshing network info cache for port b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:52 user nova-compute[74261]: INFO nova.compute.manager [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Terminating instance
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.compute.manager [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Start destroying the instance on the hypervisor. {{(pid=74261) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:52 user nova-compute[74261]: INFO nova.virt.libvirt.driver [-] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Instance destroyed successfully.
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.objects.instance [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lazy-loading 'resources' on Instance uuid 7aa2a81e-df98-4d3e-9ac4-49f77df43644 {{(pid=74261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.vif [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T12:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-382897260',display_name='tempest-TestVolumeBootPattern-server-382897260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-382897260',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJu80yPDsL5im9ttBjV6dwQA+3Eurvc8fm24eZhQY+5R9Yq1rCMiBJiezAHN1gNrWERVZcFoDHJpkaWwsnTMbxAdlmX+iRBQHLzFDb04ODMqfvutWwP+uDFOlrDHyb3oA==',key_name='tempest-TestVolumeBootPattern-367505697',keypairs=<?>,launch_index=0,launched_at=2023-10-17T12:42:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4261c4841d42488970198c3fb8fdfd',ramdisk_id='',reservation_id='r-mliu00dm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2039737599',owner_user_name='tempest-TestVolumeBootPattern-2039737599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T12:42:55Z,user_data=None,user_id='4a38d9af156c42b8ad4865b983f39da2',uuid=7aa2a81e-df98-4d3e-9ac4-49f77df43644,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converting VIF {"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.network.os_vif_util [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7') {{(pid=74261) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG os_vif [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7') {{(pid=74261) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb97dbdd1-b7, bridge=br-int, if_exists=True) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d1cd5c0-98b6-44ca-9713-5e4c3e722cb0) {{(pid=74261) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:47:52 user nova-compute[74261]: INFO os_vif [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=b97dbdd1-b7fd-429e-852e-9bf210262e83,network=Network(ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97dbdd1-b7')
Oct 17 12:47:52 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] calling os-brick to detach iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8b0c7ccc70>, {'target_iqn': 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEPtKuLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 12:47:52 user nova-compute[74261]: WARNING os_brick.initiator.connectors.base [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 12:47:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 12:47:52 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d6f30-ed49-49f9-a161-bfae22df6025]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 12:47:53 user nova-compute[74261]: No targets found.
Oct 17 12:47:53 user nova-compute[74261]: iSNS:
Oct 17 12:47:53 user nova-compute[74261]: No targets found.
Oct 17 12:47:53 user nova-compute[74261]: STATIC:
Oct 17 12:47:53 user nova-compute[74261]: Target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef
Oct 17 12:47:53 user nova-compute[74261]:         Portal: 172.16.0.220:3260,-1
Oct 17 12:47:53 user nova-compute[74261]:                 Iface Name: default
Oct 17 12:47:53 user nova-compute[74261]: FIRMWARE:
Oct 17 12:47:53 user nova-compute[74261]: No targets found.
Oct 17 12:47:53 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 12:47:53 user nova-compute[74261]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 12:47:53 user nova-compute[74261]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74261) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef', 0)] {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f5533-6ed2-40fa-ab09-84ee26f0672b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd446ef-d56d-48dc-97f1-bd97a4209dcf]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:47:53 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef (non-flash)
Oct 17 12:47:53 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8b0c2baef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef'): ({'sdb'}, set())}) {{(pid=74261) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Removing single pathed devices sdb {{(pid=74261) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e40c745-758f-490a-943e-079e4b6736dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3292ae-ff6c-48b1-a488-2b08e42ed9fd]: (4, ('ok\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Flushing IO for device /dev/sdb {{(pid=74261) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[318350d3-dc9a-43b6-b43a-2852dba82b31]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74261) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff58174-4e2d-44f0-a974-dfcbc8f333eb]: (4, ('1', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.linuxscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] SCSI volumes sdb have been removed. {{(pid=74261) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO106b8ff6-60aaf584c62c3719',) {{(pid=86003) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 12:47:53 user nova-compute[74261]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO106b8ff6-60aaf584c62c3719
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a3464a-0e70-43fb-b1c2-77ace52cda23]: (4, None) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef')] {{(pid=74261) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.network.neutron [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updated VIF entry in instance network info cache for port b97dbdd1-b7fd-429e-852e-9bf210262e83. {{(pid=74261) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.network.neutron [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [{"id": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "address": "fa:16:3e:71:5f:03", "network": {"id": "ab5fdf2f-8bcc-46c4-927d-d87a7d1a87bc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1480271448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4261c4841d42488970198c3fb8fdfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97dbdd1-b7", "ovs_interfaceid": "b97dbdd1-b7fd-429e-852e-9bf210262e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abbcc4-62b5-4a3a-8d0d-132ab24e113d]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --logout {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-d641a9c5-2896-4f19-a1c7-ecc8b59ead00 req-8d19b918-45db-4eff-aef8-db7a401589f1 service nova] Releasing lock "refresh_cache-7aa2a81e-df98-4d3e-9ac4-49f77df43644" {{(pid=74261) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf2539f-224c-4bac-bfc5-c41ef638a02f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260]
Oct 17 12:47:53 user nova-compute[74261]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef, portal: 172.16.0.220,3260] successful.
Oct 17 12:47:53 user nova-compute[74261]:  stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op delete {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0dde4d-49a4-457d-b713-1b2256512bef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86003) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ee99e-2b15-4ce0-844f-73eb9894ed09]: (4, ('', '')) {{(pid=86003) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74261) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.base [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG os_brick.initiator.connectors.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] <== disconnect_volume: return (306ms) None {{(pid=74261) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Disconnected iSCSI Volume {{(pid=74261) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 12:47:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Deleting instance files /opt/stack/data/nova/instances/7aa2a81e-df98-4d3e-9ac4-49f77df43644_del
Oct 17 12:47:53 user nova-compute[74261]: INFO nova.virt.libvirt.driver [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Deletion of /opt/stack/data/nova/instances/7aa2a81e-df98-4d3e-9ac4-49f77df43644_del complete
Oct 17 12:47:53 user nova-compute[74261]: INFO nova.compute.manager [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 17 12:47:53 user nova-compute[74261]: DEBUG oslo.service.loopingcall [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74261) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.compute.manager [-] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Deallocating network for instance {{(pid=74261) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] deallocate_for_instance() {{(pid=74261) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.network.neutron [-] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Updating instance_info_cache with network_info: [] {{(pid=74261) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 12:47:53 user nova-compute[74261]: INFO nova.compute.manager [-] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Took 0.40 seconds to deallocate network for instance.
Oct 17 12:47:53 user nova-compute[74261]: DEBUG nova.compute.manager [req-cac2383e-5818-42cc-b162-72eaf19464e2 req-ccdbe84f-1965-49db-a909-c1c37225b498 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-vif-deleted-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-vif-unplugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] No waiting events found dispatching network-vif-unplugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-vif-unplugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 for instance with task_state deleting. {{(pid=74261) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received event network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] Acquiring lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] No waiting events found dispatching network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 {{(pid=74261) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 12:47:54 user nova-compute[74261]: WARNING nova.compute.manager [req-ed0b753b-1daf-4064-b7cb-a1d13ea6b877 req-a386df38-a016-4f23-9696-40b7fbfbd943 service nova] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Received unexpected event network-vif-plugged-b97dbdd1-b7fd-429e-852e-9bf210262e83 for instance with vm_state active and task_state deleting.
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:47:54 user nova-compute[74261]: INFO nova.compute.manager [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] [instance: 7aa2a81e-df98-4d3e-9ac4-49f77df43644] Took 0.81 seconds to detach 1 volumes for instance.
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:54 user nova-compute[74261]: INFO nova.scheduler.client.report [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Deleted allocations for instance 7aa2a81e-df98-4d3e-9ac4-49f77df43644
Oct 17 12:47:54 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-796e41d5-9ab6-481d-b852-26ba7c37c43f tempest-TestVolumeBootPattern-2039737599 tempest-TestVolumeBootPattern-2039737599-project-member] Lock "7aa2a81e-df98-4d3e-9ac4-49f77df43644" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.678s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:47:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:56 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:47:57 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:47:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:48:02 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:48:02 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:48:02 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.137062072753906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:02 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:48:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:48:03 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:48:03 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:48:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:48:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:48:04 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:48:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:48:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:48:07 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:48:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:12 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:17 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:22 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:48:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:27 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:32 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:48:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:48:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:50 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:53 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:55 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:55 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:48:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:48:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:48:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:01 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:49:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:49:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9130MB free_disk=25.12786102294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:49:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:49:04 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:49:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:49:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:49:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:11 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:49:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:38 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:43 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:48 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:49 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:51 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:53 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:49:55 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:57 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:57 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74261) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 12:49:58 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:49:58 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:49:59 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Auditing locally available compute resources for user (node: user) {{(pid=74261) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 12:50:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:50:03 user nova-compute[74261]: WARNING nova.virt.libvirt.driver [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=25.126480102539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74261) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74261) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.compute.provider_tree [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed in ProviderTree for provider: d51b7aad-e6a4-40b3-931d-8430348db4c8 {{(pid=74261) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.scheduler.client.report [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Inventory has not changed for provider d51b7aad-e6a4-40b3-931d-8430348db4c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74261) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG nova.compute.resource_tracker [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Compute_service record updated for user:user {{(pid=74261) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 12:50:03 user nova-compute[74261]: DEBUG oslo_concurrency.lockutils [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74261) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 12:50:04 user nova-compute[74261]: DEBUG oslo_service.periodic_task [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74261) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 12:50:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Starting heal instance info cache {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 12:50:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Rebuilding the list of instances to heal {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 12:50:04 user nova-compute[74261]: DEBUG nova.compute.manager [None req-612bebad-5d05-4d8c-a582-f8577da4e511 None None] Didn't find any instances for network info cache update. {{(pid=74261) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 12:50:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:50:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:50:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:50:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:50:08 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:10 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:13 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:18 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:23 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:50:28 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 12:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 12:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74261) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 12:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74261) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 12:50:33 user nova-compute[74261]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74261) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}